-- Logs begin at Thu 2022-08-25 01:51:11 UTC, end at Thu 2022-08-25 03:32:46 UTC. -- Aug 25 02:57:26.948597 dv-cinder-779578-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 02:57:26.957857 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 02:57:26 2022] *** Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: nodename: dv-cinder-779578-6-iscsi Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: machine: x86_64 Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: clock source: unix Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: pcre jit disabled Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: detected number of CPU cores: 4 Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: current working directory: / Aug 25 02:57:26.959831 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: detected binary path: /usr/bin/uwsgi-core Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: your processes number limit is 47680 Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: your memory page size is 4096 bytes Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: detected max file descriptor number: 2048 Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: lock engine: pthread robust mutexes Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: thunder lock: enabled Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 02:57:26.960678 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 02:57:26.999185 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: Python main interpreter initialized at 0x558e1374d9c0 Aug 25 02:57:26.999185 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: python threads support enabled Aug 25 02:57:26.999185 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: your server socket listen backlog is limited to 100 connections Aug 25 02:57:26.999185 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: your mercy for graceful operations on workers is 90 seconds Aug 25 02:57:27.000225 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 02:57:27.000225 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: *** Operational MODE: preforking *** Aug 25 02:57:27.000376 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: *** uWSGI is running in multiple interpreter mode *** Aug 25 02:57:27.000376 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: spawned uWSGI master process (pid: 106238) Aug 25 02:57:27.000573 dv-cinder-779578-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 02:57:27.001908 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: spawned uWSGI worker 1 (pid: 106239, cores: 1) Aug 25 02:57:27.001908 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: spawned uWSGI worker 2 (pid: 106240, cores: 1) Aug 25 02:57:27.001908 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 02:57:27.671603 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 02:57:27.682695 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 02:57:28.764468 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:57:28.764468 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: from cryptography.utils import int_from_bytes Aug 25 02:57:28.765706 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:57:28.765706 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: from cryptography.utils import int_from_bytes Aug 25 02:57:28.780047 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:57:28.780047 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: from cryptography.utils import int_from_bytes Aug 25 02:57:28.780504 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:57:28.780504 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: from cryptography.utils import int_from_bytes Aug 25 02:57:31.248547 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:57:31.249112 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:57:31.249225 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:57:31.250213 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:57:31.250607 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:57:31.250995 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.251321 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.251639 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.251958 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.252314 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.252631 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.252942 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.253261 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.253584 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.253841 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.254150 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.254469 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-6-iscsi {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.254786 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.254948 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:57:31.255344 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.255429 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:57:31.255509 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.255688 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.255778 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:57:31.255988 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.256077 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:57:31.256323 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:57:31.256426 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.256638 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.256726 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257023 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257136 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257344 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257572 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257698 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.257994 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258187 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258314 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258520 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258619 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258834 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.258937 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259142 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259232 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259431 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259519 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259747 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.259886 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260067 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260184 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-6-iscsi {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260400 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260498 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260723 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.260818 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-6-iscsi {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261033 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261133 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261349 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261438 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261651 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261741 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.261969 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262109 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262272 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262368 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262680 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262812 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.262999 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263108 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263318 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263419 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263626 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263722 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.263949 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264037 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264411 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264603 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264690 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.264945 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.265049 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.265359 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.265670 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.265766 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.265977 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266080 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266301 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266391 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266607 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266705 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-6-iscsi {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.266912 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267001 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267162 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267297 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267469 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267613 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.267789 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268024 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268114 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268366 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268467 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268677 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268774 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.268925 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269242 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269343 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269559 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269649 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269868 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.269958 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270177 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270343 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270484 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270582 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270792 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.270881 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271098 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271189 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271405 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271498 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271708 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.271803 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272016 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272113 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272345 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272435 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272651 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272865 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.272972 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273064 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273196 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273301 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273516 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273607 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273836 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.273948 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274157 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274255 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274406 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274505 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274656 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274819 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.274972 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275136 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275291 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275445 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275601 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275763 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.275908 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276084 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276241 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276421 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276549 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276731 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.276856 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.277039 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.277162 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.277620 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.277731 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.277953 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278042 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278257 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278355 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278506 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278642 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278807 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.278962 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279112 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279270 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279428 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279589 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279735 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.279996 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280095 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280282 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280373 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280812 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.280974 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.281281 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.281404 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.281586 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.281726 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.281891 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282040 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282198 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282362 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282499 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282687 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.282804 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283002 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283113 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283311 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283409 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283619 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283744 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.283939 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284045 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284290 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284388 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284601 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284692 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284853 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.284943 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285157 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285254 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285464 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285566 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285781 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.285871 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286083 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286171 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286391 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286479 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286699 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.286789 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287001 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287088 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287306 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287401 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287611 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287699 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.287916 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288005 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288244 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288335 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288545 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288635 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288848 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.288935 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289158 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289314 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289463 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289554 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289768 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.289855 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290069 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290166 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290373 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290492 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290680 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290780 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.290986 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291083 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291287 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291421 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291589 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291689 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291889 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.291992 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292224 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292317 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292533 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292622 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292838 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.292939 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293142 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293239 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293448 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293535 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293762 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.293858 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.294068 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.294155 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.294374 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.294463 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.294691 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.294790 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.294991 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.295096 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.295301 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.295390 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.295615 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.295705 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.295922 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.296011 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.296827 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.297148 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.297306 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.297474 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.297624 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.297788 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.297935 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.298102 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.298271 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.298416 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.298540 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.298735 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.298831 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.299056 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.299155 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.299384 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.299481 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.299703 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.299793 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.300022 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.300120 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.300363 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.300462 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.300672 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.300759 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.300979 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.301069 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.301306 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.301393 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:57:31.301625 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.301713 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.301935 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302025 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302275 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302363 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302587 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302698 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.302915 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303004 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303240 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303334 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303557 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303653 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303867 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.303955 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304197 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304301 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304512 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304610 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304830 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.304919 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305145 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305235 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305461 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305558 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305776 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.305862 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306086 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306176 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306398 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306496 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306711 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.306800 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307022 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307112 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307333 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307431 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307644 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307731 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.307963 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308051 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308295 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308398 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308610 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308699 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.308925 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309014 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309237 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309327 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309547 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309642 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309857 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.309945 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310160 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310250 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310462 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310551 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310763 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.310853 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.311070 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.311160 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.311373 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.311461 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.311696 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.312451 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.312611 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.312921 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313145 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313257 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313466 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313570 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313789 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.313878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314106 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314195 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314419 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314520 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314733 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.314824 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315046 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315135 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315356 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315453 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315660 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315749 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.315980 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316068 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316315 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316425 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316628 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316715 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.316946 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317034 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317248 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317337 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317550 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317859 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.317947 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318166 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318268 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318470 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318559 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318774 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.318862 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319085 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319181 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319387 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319482 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319705 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.319794 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320019 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320117 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320361 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320461 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320688 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320788 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.320993 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321081 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321310 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321399 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321622 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321785 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.321931 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322022 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322230 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322318 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322541 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322639 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322844 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.322933 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323146 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323235 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323446 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323541 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323754 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.323844 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324056 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324163 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324380 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324469 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324680 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324777 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.324981 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325282 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325379 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325593 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325688 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325898 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.325986 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326198 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326296 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326499 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326595 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326805 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.326893 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.327121 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.327210 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.327478 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.327820 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328038 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328169 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328421 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328517 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328757 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.328851 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329066 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329169 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329391 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329482 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329704 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.329806 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330019 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330123 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330324 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330413 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330634 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330728 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.330937 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331034 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331243 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331341 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331554 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331650 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331863 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.331951 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332195 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332285 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332487 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332588 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332791 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.332886 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333093 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333181 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333394 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333491 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333714 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.333808 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334026 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334115 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334329 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334417 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334634 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334727 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.334936 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335024 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335248 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335352 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335556 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335647 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335866 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.335955 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336194 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336305 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336513 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336610 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336832 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.336928 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337142 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337244 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337456 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337544 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337764 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.337851 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338074 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338172 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338381 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338470 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338690 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338777 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.338991 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339088 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339305 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339394 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339621 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339717 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.339933 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340026 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340267 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340357 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340575 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340662 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340895 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.340984 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341197 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341285 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341503 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341636 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341815 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.341913 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342120 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342209 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342430 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342533 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342742 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.342834 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.343081 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.343207 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.343392 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.343700 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.343875 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344005 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344216 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344341 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344534 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344682 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344848 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.344938 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345164 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345261 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345484 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345591 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345797 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.345887 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346117 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346207 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346431 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346534 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346754 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.346841 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347059 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347154 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347363 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347461 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347667 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347755 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.347978 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348066 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348304 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348396 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348608 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348708 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.348909 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349006 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349242 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349483 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349793 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349908 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.349999 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350080 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350176 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350259 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350447 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350549 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350751 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.350847 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351058 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351158 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351366 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351466 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351777 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.351982 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352072 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352316 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352418 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352621 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352721 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.352934 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353032 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353230 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353319 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353531 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353669 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353836 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.353927 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354148 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354272 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354454 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354551 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354762 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.354851 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355067 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355156 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355367 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355458 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355764 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.355977 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.356064 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.356321 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.356569 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.356660 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.356902 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357002 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357214 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357311 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357514 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357603 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357834 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.357930 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.358151 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.358249 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.358455 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.358543 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.359396 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.359734 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.359838 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360042 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360196 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360376 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360466 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360682 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360772 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.360987 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361078 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361297 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361393 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361601 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361698 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361907 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.361998 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362209 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362300 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362519 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362616 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362821 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.362911 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363122 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363211 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363422 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363512 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363724 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.363813 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364034 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364136 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364359 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364451 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364667 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364760 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.364968 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365067 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365277 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365373 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365584 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365673 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.365888 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366146 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366244 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366477 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366575 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366791 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.366889 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.367110 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.367201 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.367474 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.367733 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.367936 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368079 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368346 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368453 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368693 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368989 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.368989 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.369348 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.369481 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.369597 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.369792 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.369965 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370118 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370210 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370425 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370515 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370731 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.370830 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371034 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371124 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371347 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371648 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371744 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.371949 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372038 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372272 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372365 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372578 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372670 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372888 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.372977 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373187 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373282 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373493 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373590 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373798 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.373887 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.374103 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.374237 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.375006 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.375319 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.375527 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.375705 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.375844 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376011 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376229 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376334 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376483 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376647 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376830 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.376992 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377137 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377234 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377476 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377802 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.377901 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378135 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378230 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378438 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378528 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378740 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.378829 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379050 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379146 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379351 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379438 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379653 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379743 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.379954 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380046 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380288 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380386 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380593 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380682 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380891 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.380981 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381200 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381289 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381503 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381591 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381807 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.381954 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382112 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382209 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382412 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382503 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382724 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.382814 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383023 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383124 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383334 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383432 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383727 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.383940 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384039 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384261 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384352 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384571 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384659 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384870 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.384968 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385169 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385265 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385467 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385554 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385766 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.385864 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386065 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386153 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386371 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386459 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386673 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386775 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.386971 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387059 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387275 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387371 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387577 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387667 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387878 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.387966 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388223 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388329 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388540 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388630 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388844 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.388934 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389145 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389244 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389455 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389545 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389758 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.389893 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.390164 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.390575 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.390680 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.390796 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.390885 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391110 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391199 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391420 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391510 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391730 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.391826 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392033 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392122 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392360 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392461 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392680 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.392986 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393083 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393294 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393382 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393592 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393688 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393892 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.393991 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394192 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394282 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394494 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394584 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394794 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.394896 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395104 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395191 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395411 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395504 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395711 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.395810 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396013 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396339 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396430 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396648 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396737 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.396958 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397047 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397269 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397372 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397585 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397677 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397885 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.397982 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398192 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398282 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398500 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398596 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398798 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.398885 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399108 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399204 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399412 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399502 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399710 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.399805 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400017 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400119 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400347 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400648 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400736 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.400946 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401044 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401262 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401356 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401574 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401663 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401883 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.401986 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.402199 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.402554 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.402789 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.402886 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403100 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403196 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403399 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403487 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403707 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.403794 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404008 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404109 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404339 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404428 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404645 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404734 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.404953 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405044 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405264 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405353 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405641 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405781 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.405949 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.406228 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.406405 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.406547 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.406720 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.406848 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407032 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407149 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407339 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407437 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407650 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407753 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.407959 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408051 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408289 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408396 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408613 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408773 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.408922 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409082 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409225 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409384 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409534 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409795 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.409885 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410106 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410196 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410416 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410505 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410733 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.410824 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411052 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411145 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411370 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411472 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411764 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.411985 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412082 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412317 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412420 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412639 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412734 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.412958 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413048 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413262 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413361 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413576 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413670 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413879 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.413968 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414200 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414355 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414521 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414614 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414835 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.414934 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415136 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415225 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415446 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415546 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415764 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.415861 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416067 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416199 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416396 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416570 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416698 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.416789 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417017 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417107 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417320 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417418 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417635 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417726 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.417956 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418044 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418262 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418352 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418582 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418673 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.418886 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419028 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419195 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419338 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419504 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419649 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419811 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.419965 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420115 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420310 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420438 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420630 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420758 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.420932 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.421062 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.421927 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422239 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422536 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422637 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422856 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.422944 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423161 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423250 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423479 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423578 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423790 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.423882 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424094 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424203 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424419 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424521 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424721 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.424811 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425052 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425141 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425353 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425443 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.425764 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426002 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426097 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426326 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426431 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426635 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426725 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.426971 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427278 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427368 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427581 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427671 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.427893 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428002 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428217 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428313 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428523 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428616 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428825 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.428922 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429130 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429219 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429434 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429522 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429737 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.429836 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430041 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430140 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430341 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430437 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430641 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430738 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.430941 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431030 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431242 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431331 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431557 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431646 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431858 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.431946 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432194 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432285 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432506 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432604 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432808 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.432905 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433111 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433201 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433411 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433502 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433710 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.433798 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434012 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434110 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434313 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434404 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434652 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434751 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.434953 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435050 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435276 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435398 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435588 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435690 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.435903 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.436006 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.436233 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.436338 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.436546 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.436635 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.437528 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.437846 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.438158 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.438475 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.438564 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.438789 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.438888 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439106 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439204 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439534 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439624 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439844 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.439943 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440172 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440264 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440490 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440593 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440799 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.440898 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441105 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441197 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441411 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441510 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441724 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.441829 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442028 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442119 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442331 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442421 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442634 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442735 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.442956 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443046 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443262 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443351 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443581 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443673 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443892 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.443989 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444219 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444323 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444528 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444830 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.444923 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445173 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445264 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445478 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445569 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445806 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.445940 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446119 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446219 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446428 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446526 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446741 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.446839 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447052 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447221 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447365 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447455 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447671 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447766 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.447981 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448083 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448315 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448418 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448626 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448716 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.448937 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449027 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449247 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449335 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449558 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449659 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449874 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.449964 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.450206 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.450402 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.450524 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.450737 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.450839 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451058 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451148 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451374 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451463 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451689 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.451943 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.452033 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.452281 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.452458 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.452673 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453163 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453315 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453480 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453633 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453800 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.453949 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454121 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454273 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454454 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454578 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454781 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.454926 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455110 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455200 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455449 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455539 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455756 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.455846 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456076 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456201 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456410 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456500 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456713 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.456817 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457033 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457124 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457346 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457449 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457670 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457881 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.457971 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458233 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458322 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458556 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458647 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458882 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.458970 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459193 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459283 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459507 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459604 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459813 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.459901 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460123 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460271 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460455 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460545 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460762 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.460852 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461073 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461170 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461381 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461469 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461683 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461772 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.461987 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462090 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462300 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462390 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462613 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462703 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.462916 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463014 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463228 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463443 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463535 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463760 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.463863 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464092 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464241 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464443 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464535 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464748 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.464894 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465063 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465153 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465368 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465458 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465773 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.465977 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466111 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466279 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466368 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466589 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466689 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466890 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.466980 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467190 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467279 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467495 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467583 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467807 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.467897 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.468134 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.468464 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.468590 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.468768 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.468934 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.469088 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.469253 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.469391 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.469736 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.469834 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470053 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470143 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470362 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470459 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470681 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470773 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.470995 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471086 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471306 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471404 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471651 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471741 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.471966 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472056 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472298 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472525 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472618 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472857 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.472956 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473179 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473275 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473505 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473811 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.473902 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474124 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474216 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474428 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474519 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474729 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.474826 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475042 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475144 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475345 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475435 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475653 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475740 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.475963 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476065 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476292 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476394 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476600 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476690 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.476913 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477081 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477220 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477319 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477525 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477615 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477831 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.477922 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478134 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478232 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478440 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478528 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478740 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.478836 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479046 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479142 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479348 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479437 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479659 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479749 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.479961 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480049 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480324 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480417 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480613 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480706 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.480926 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481022 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481227 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481329 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481531 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481620 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481838 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.481927 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482141 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482240 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482446 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482536 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482757 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.482847 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.483080 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.483179 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.483389 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.483479 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.484249 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.484672 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.484874 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.484987 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.485287 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.485423 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.485607 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.485765 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.485915 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486091 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486233 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486429 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486552 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486768 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.486867 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487079 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487169 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487388 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487479 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487698 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.487796 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488027 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488125 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488368 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488611 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488706 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488792 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.488985 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489299 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489396 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489601 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489699 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.489910 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490040 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490222 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490312 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490525 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490614 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490826 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.490927 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491126 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491230 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491434 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491527 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491736 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.491834 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492038 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492194 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492364 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492466 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492663 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492752 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.492970 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493270 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493360 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493570 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493661 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493871 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.493969 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494170 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494260 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494468 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494565 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494768 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.494859 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495074 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495166 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495376 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495467 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495679 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.495978 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496303 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496407 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496604 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496703 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.496931 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497045 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497264 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497362 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497577 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497675 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497895 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.497990 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498205 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498304 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498525 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498656 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498833 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.498924 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.499149 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.499319 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.500136 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.500477 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.500566 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.500795 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.500901 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501133 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501236 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501447 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501545 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501760 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.501859 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502076 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502165 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502390 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502480 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502704 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.502801 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503011 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503102 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503324 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503413 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503645 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503744 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.503948 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504037 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504294 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504387 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504614 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504707 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.504933 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505029 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505235 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505327 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505541 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505632 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505845 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.505936 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506146 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506236 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506453 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506590 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506754 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.506843 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507055 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507226 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507356 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507446 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507656 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507754 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.507957 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508055 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508283 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508375 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508595 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508684 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508896 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.508998 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509198 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509295 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509497 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509587 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509800 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.509903 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510099 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510196 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510428 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510527 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510759 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.510850 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511068 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511155 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511388 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511476 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511700 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.511790 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512016 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512104 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512349 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512451 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512649 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512738 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.512890 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:57:31.512982 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.513273 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.513590 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.513922 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.514233 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.514543 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.514875 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.515686 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.516009 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.516350 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.516681 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.517010 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.517319 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.517643 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.517962 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.518281 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.518600 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.518910 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.519239 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.519549 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.519858 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.520192 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.520509 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.520819 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.521134 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.521444 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.521754 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.522069 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.522420 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.522711 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.523133 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.523396 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.523727 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.524049 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.524418 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.524731 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.525073 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.525396 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.525710 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.526019 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.526320 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:57:31.526559 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:57:31.668330 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO dbcounter [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Registered counter for database nova_api Aug 25 02:57:31.685125 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO dbcounter [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Registered counter for database nova_api Aug 25 02:57:31.689971 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.696612 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.708292 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_db.sqlalchemy.engines [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.714784 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writer thread running {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.752692 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.context [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),429328db-c6b7-4f53-8dd7-047f5c486dbd(cell1) {{(pid=106239) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 02:57:31.756501 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 02:57:31.756967 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 02:57:31.758531 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 02:57:31.759267 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 02:57:31.759708 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 02:57:31.761693 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 02:57:31.763643 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO dbcounter [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Registered counter for database nova_cell0 Aug 25 02:57:31.769961 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO dbcounter [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Registered counter for database nova_cell1 Aug 25 02:57:31.770089 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.context [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),429328db-c6b7-4f53-8dd7-047f5c486dbd(cell1) {{(pid=106240) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 02:57:31.773801 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 02:57:31.774265 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 02:57:31.775816 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 02:57:31.776566 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 02:57:31.777007 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 02:57:31.777807 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.779245 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_concurrency.lockutils [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 02:57:31.780441 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.781424 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO dbcounter [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Registered counter for database nova_cell0 Aug 25 02:57:31.786050 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.786878 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO dbcounter [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Registered counter for database nova_cell1 Aug 25 02:57:31.793909 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_db.sqlalchemy.engines [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.795691 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_db.sqlalchemy.engines [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.801538 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writer thread running {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.803296 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writer thread running {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.921916 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.935126 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO dbcounter [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Registered counter for database nova_cell0 Aug 25 02:57:31.943076 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_db.sqlalchemy.engines [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.946957 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO dbcounter [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Registered counter for database nova_cell0 Aug 25 02:57:31.947707 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writer thread running {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:31.956116 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG oslo_db.sqlalchemy.engines [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:57:31.960381 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writer thread running {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:57:32.375226 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 02:57:32.382604 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 02:57:32.410397 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: WARNING keystonemiddleware.auth_token [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 02:57:32.417770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: WARNING keystonemiddleware.auth_token [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 02:57:32.727182 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 02:57:32.733052 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: WARNING keystonemiddleware.auth_token [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 02:57:32.738628 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e1374d9c0 pid: 106239 (default app) Aug 25 02:57:32.740707 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:57:32.741878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 25 02:57:32.742301 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Thu Aug 25 02:57:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:57:32.765357 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: WARNING keystonemiddleware.auth_token [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 02:57:32.771647 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: WARNING keystonemiddleware.auth_token [None req-e18d9ac0-c156-4036-872c-ca74d5a411e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 02:57:32.776942 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e1374d9c0 pid: 106240 (default app) Aug 25 02:58:54.224873 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:58:54.225887 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 25 02:58:54.227674 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:58:54.244843 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_api:SELECT=3 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:54.245940 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_cell1:SELECT=3 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:54.246904 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_cell0:SELECT=3 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:54.247977 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:55.155328 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-dcfbae9f-4bde-460c-8d8c-67f546287c46 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:58:55.189747 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-dcfbae9f-4bde-460c-8d8c-67f546287c46 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955348 Aug 25 02:58:55.190503 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1292 bytes} [Thu Aug 25 02:58:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:58:57.606634 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:58:57.607702 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-25b43f03-2f31-4c2b-b562-301b0faa38c2 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Aug 25 02:58:57.609369 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:58:58.057393 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-d3a8500f-23fe-4b81-8258-d1f6b0083217 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "disk": 1, "vcpus": 1}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:58:58.176449 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-d3a8500f-23fe-4b81-8258-d1f6b0083217 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560184 Aug 25 02:58:58.177290 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:58:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:58:58.190762 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:58.191604 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell0:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:58.192708 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell1:SELECT=3 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:58.193767 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:58.404362 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-c31ec568-251d-4d2e-b4f3-a08bf54ad049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:58:58.517799 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-c31ec568-251d-4d2e-b4f3-a08bf54ad049 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.332204 Aug 25 02:58:58.518534 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1336 bytes} [Thu Aug 25 02:58:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:00.914116 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-d3a8500f-23fe-4b81-8258-d1f6b0083217 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:00.915700 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-d3a8500f-23fe-4b81-8258-d1f6b0083217 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Aug 25 02:59:00.916310 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 02:59:01.577082 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-4a173804-6a8b-4215-bf89-533d6d317cb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:01.704571 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-4a173804-6a8b-4215-bf89-533d6d317cb3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.781013 Aug 25 02:59:01.705223 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:01.717667 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-8312388c-2b21-4f18-ab1f-1c33ec11906e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:01.809805 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-8312388c-2b21-4f18-ab1f-1c33ec11906e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095968 Aug 25 02:59:01.810729 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1336 bytes} [Thu Aug 25 02:59:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:04.189223 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-4a173804-6a8b-4215-bf89-533d6d317cb3 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:04.190295 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-4a173804-6a8b-4215-bf89-533d6d317cb3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 25 02:59:04.190719 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:04.587467 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-fbff7717-4782-40a7-af3c-64b811ab9b2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "id": "d2"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:04.662808 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-fbff7717-4782-40a7-af3c-64b811ab9b2e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465973 Aug 25 02:59:04.663371 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:04.675464 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-09487244-d935-4a00-b23e-d12a4d837e87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:04.786684 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-09487244-d935-4a00-b23e-d12a4d837e87 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114933 Aug 25 02:59:04.787642 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1336 bytes} [Thu Aug 25 02:59:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:07.258461 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-fbff7717-4782-40a7-af3c-64b811ab9b2e admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:07.259399 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-fbff7717-4782-40a7-af3c-64b811ab9b2e admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 25 02:59:07.259798 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:07.719218 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-c886302d-2a52-41b4-8ddf-90bf961cc82f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:07.823090 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-c886302d-2a52-41b4-8ddf-90bf961cc82f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557063 Aug 25 02:59:07.823767 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:07.837110 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-58258e8c-6fd0-4ba3-bf57-67ef6e5c803f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:07.914304 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-58258e8c-6fd0-4ba3-bf57-67ef6e5c803f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081191 Aug 25 02:59:07.915584 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1336 bytes} [Thu Aug 25 02:59:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:10.356039 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-c886302d-2a52-41b4-8ddf-90bf961cc82f admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:10.356996 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-c886302d-2a52-41b4-8ddf-90bf961cc82f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 25 02:59:10.357661 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:10.790316 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:11.126120 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.761930 Aug 25 02:59:11.126807 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:11.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-74f12941-42ce-433b-93a6-7b3861781c13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:11.301781 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-74f12941-42ce-433b-93a6-7b3861781c13 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.166442 Aug 25 02:59:11.302470 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1336 bytes} [Thu Aug 25 02:59:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:13.747057 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:13.748208 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 25 02:59:13.748607 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:14.171053 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-a386a2a8-341a-4c4a-bfd7-257a5af741aa admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:14.198681 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-a386a2a8-341a-4c4a-bfd7-257a5af741aa admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443674 Aug 25 02:59:14.199299 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1292 bytes} [Thu Aug 25 02:59:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:16.571743 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:16.571743 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-b7754cb0-9e24-4157-8bf3-3ec66790a3ad admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 25 02:59:16.571743 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:17.002586 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-1af2bfee-ce6f-4b1b-a543-71320534c5d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:17.067996 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-1af2bfee-ce6f-4b1b-a543-71320534c5d3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.490877 Aug 25 02:59:17.068585 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:17.081677 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-64b3aeb6-9dd6-41fd-a2a0-589bd59231b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:17.178952 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-64b3aeb6-9dd6-41fd-a2a0-589bd59231b3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101370 Aug 25 02:59:17.179896 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1333 bytes} [Thu Aug 25 02:59:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:19.571750 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-1af2bfee-ce6f-4b1b-a543-71320534c5d3 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:19.572837 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-1af2bfee-ce6f-4b1b-a543-71320534c5d3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 25 02:59:19.573235 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:19.985119 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-7dd80105-c588-4b7e-ad50-8b2a37873e14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "ram": 2048, "disk": 20}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:20.085588 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-7dd80105-c588-4b7e-ad50-8b2a37873e14 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.505604 Aug 25 02:59:20.086122 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:20.100099 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-7bdc3c7c-19fb-4b3d-abe5-a040253af288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:20.169475 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-7bdc3c7c-19fb-4b3d-abe5-a040253af288 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072979 Aug 25 02:59:20.170062 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1333 bytes} [Thu Aug 25 02:59:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:22.619945 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-7dd80105-c588-4b7e-ad50-8b2a37873e14 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:22.621639 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-7dd80105-c588-4b7e-ad50-8b2a37873e14 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Aug 25 02:59:22.622038 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:23.072488 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-8077036c-07d2-4025-b147-e13be4385360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "id": "3", "disk": 40, "ram": 4096}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:23.148329 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-8077036c-07d2-4025-b147-e13be4385360 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.518491 Aug 25 02:59:23.157305 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 02:59:23.162105 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-aa4aec66-d3be-4bfb-ae9d-519c4408d31a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:23.272032 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-aa4aec66-d3be-4bfb-ae9d-519c4408d31a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113505 Aug 25 02:59:23.272589 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1333 bytes} [Thu Aug 25 02:59:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:25.715297 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-8077036c-07d2-4025-b147-e13be4385360 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:25.716346 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-8077036c-07d2-4025-b147-e13be4385360 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 25 02:59:25.720385 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:26.186294 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-85ad072b-c822-4e32-a176-74742d2f21c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large", "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "disk": 80}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:26.192292 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:26.257089 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-85ad072b-c822-4e32-a176-74742d2f21c4 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.532709 Aug 25 02:59:26.257928 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:26.270483 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-caf6c01a-d090-465e-8b1d-fe1c56100b49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:26.353057 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-caf6c01a-d090-465e-8b1d-fe1c56100b49 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085708 Aug 25 02:59:26.354231 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1333 bytes} [Thu Aug 25 02:59:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 02:59:28.761596 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-85ad072b-c822-4e32-a176-74742d2f21c4 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:28.762609 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-85ad072b-c822-4e32-a176-74742d2f21c4 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 25 02:59:28.763012 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:29.213421 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "name": "m1.xlarge", "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:29.220732 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:29.302913 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533465 Aug 25 02:59:29.303389 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1283 bytes} [Thu Aug 25 02:59:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:29.318310 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-3d910f51-f2b1-428e-9b71-8219249249c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:29.401371 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-3d910f51-f2b1-428e-9b71-8219249249c5 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089296 Aug 25 02:59:29.412045 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1333 bytes} [Thu Aug 25 02:59:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 02:59:48.631282 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:48.632341 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 25 02:59:48.632744 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 02:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:49.023879 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-f2c7e41d-d48d-438c-99d6-232aff91a323 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:49.042156 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-f2c7e41d-d48d-438c-99d6-232aff91a323 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403529 Aug 25 02:59:49.042688 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1292 bytes} [Thu Aug 25 02:59:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 02:59:50.103684 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:50.104720 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-cc6c9bb0-2d3c-4e4c-965b-3a2895f3cc71 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 25 02:59:50.105125 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:50.667661 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b5416ebf-e790-415a-b78d-cc66645f5748 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:50.673909 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.wsgi [None req-b5416ebf-e790-415a-b78d-cc66645f5748 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b5416ebf-e790-415a-b78d-cc66645f5748 admin admin] Request method failure captured: Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept: application/json Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept-Encoding: gzip, deflate Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Connection: keep-alive Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Content-Length: 0 Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Host: 10.222.0.75 Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-System-Scope: None Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: User-Agent: python-novaclient Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Auth-Token: gAAAAABjBuWle7h3XUsRZz8iWRNx7wV__mXBDAmeVQ2TbRtD7IKYBkSnvtjnNWgQ51lOGDXPCtjcmuy6GqcvUxDZkouy73WXzhnQf7Mnv8iwlZRzhle_vE4Hil0jQLVMhcr_ZYwUgFerRul5BzT9YGBc-SRMTgVJfRyoKc_A2ien6Zu7FxV-Rbs Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Id: None Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Name: None Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Identity-Status: Confirmed Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Is-Admin-Project: True Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Id: default Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Name: Default Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Name: admin Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Role: admin,member,reader Aug 25 02:59:50.678389 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Roles: admin,member,reader Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant: admin Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Name: admin Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User: admin Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Id: default Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Name: Default Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Name: admin Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: method: > Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: exception: Flavor 42 could not be found. Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: action_args: {'id': '42'} Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:50.680238 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:50.681266 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.682638 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-b5416ebf-e790-415a-b78d-cc66645f5748 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:50.683881 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-b5416ebf-e790-415a-b78d-cc66645f5748 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.424934 Aug 25 02:59:50.683881 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Aug 25 02:59:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:50.693428 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-36303368-e518-4cb9-95ea-a12f71608e1a admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:50.716758 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-36303368-e518-4cb9-95ea-a12f71608e1a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027062 Aug 25 02:59:50.717440 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:50.729005 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-7b5dd514-61b4-49df-9294-af5ccdcd979d admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:50.756705 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-7b5dd514-61b4-49df-9294-af5ccdcd979d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032400 Aug 25 02:59:50.757272 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 02:59:50.767434 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed0d7f7a-ef7c-467c-83a9-3d28b3dbd7a1 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:50.773983 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-ed0d7f7a-ef7c-467c-83a9-3d28b3dbd7a1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed0d7f7a-ef7c-467c-83a9-3d28b3dbd7a1 admin admin] Request method failure captured: Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept: application/json Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Connection: keep-alive Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Content-Length: 0 Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Host: 10.222.0.75 Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-System-Scope: None Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: User-Agent: python-novaclient Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjBuWle7h3XUsRZz8iWRNx7wV__mXBDAmeVQ2TbRtD7IKYBkSnvtjnNWgQ51lOGDXPCtjcmuy6GqcvUxDZkouy73WXzhnQf7Mnv8iwlZRzhle_vE4Hil0jQLVMhcr_ZYwUgFerRul5BzT9YGBc-SRMTgVJfRyoKc_A2ien6Zu7FxV-Rbs Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Id: None Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Name: None Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Identity-Status: Confirmed Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Is-Admin-Project: True Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Id: default Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Name: Default Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Name: admin Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Role: admin,member,reader Aug 25 02:59:50.777342 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Roles: admin,member,reader Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant: admin Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Name: admin Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User: admin Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Id: default Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Name: Default Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Name: admin Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: method: > Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: exception: Flavor 42 could not be found. Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: action_args: {'id': '42'} Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:50.788350 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:50.789840 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:50.792288 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-ed0d7f7a-ef7c-467c-83a9-3d28b3dbd7a1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:50.794175 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-ed0d7f7a-ef7c-467c-83a9-3d28b3dbd7a1 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015475 Aug 25 02:59:50.794175 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Aug 25 02:59:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:51.761164 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-7b5dd514-61b4-49df-9294-af5ccdcd979d admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:51.762164 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-7b5dd514-61b4-49df-9294-af5ccdcd979d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 25 02:59:51.762584 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:52.290117 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-d404e5a3-2bf1-43c7-9b8f-a2b80ff64dc3 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:52.295503 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-d404e5a3-2bf1-43c7-9b8f-a2b80ff64dc3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-d404e5a3-2bf1-43c7-9b8f-a2b80ff64dc3 admin admin] Request method failure captured: Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept: application/json Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Connection: keep-alive Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Content-Length: 0 Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Host: 10.222.0.75 Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-System-Scope: None Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: User-Agent: python-novaclient Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjBuWnyYpTYkMHVITVHmEJ3fW_HPCYQ9pheA1PUfZTZBK5D9mIKMDWBlWYxyIj0Lb8nwSqjk3Jp5tY2VK43L5hrnkw23-nJy_GCT7PRdo7M1Dki-QVHCG7naJz1F8XRGzDDCrGT4eBIQY1MO7RMkwAG-2LmcNEgtIfPyAxrsJbn3TZ20U Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Id: None Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Name: None Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Identity-Status: Confirmed Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Is-Admin-Project: True Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Id: default Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Name: Default Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Name: admin Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Role: admin,member,reader Aug 25 02:59:52.297071 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Roles: admin,member,reader Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant: admin Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Name: admin Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User: admin Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Id: default Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Name: Default Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Name: admin Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: method: > Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: exception: Flavor 84 could not be found. Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: action_args: {'id': '84'} Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:52.298595 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:52.299574 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.300878 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-d404e5a3-2bf1-43c7-9b8f-a2b80ff64dc3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:52.302311 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-d404e5a3-2bf1-43c7-9b8f-a2b80ff64dc3 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398656 Aug 25 02:59:52.302311 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Aug 25 02:59:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:52.312575 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-cdb40ac6-2280-48cb-9199-c74a18c8855e admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:52.328441 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-cdb40ac6-2280-48cb-9199-c74a18c8855e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020109 Aug 25 02:59:52.328966 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:52.338497 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-da4aca68-ffd9-4978-90a1-383c6949fa89 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:52.353960 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-da4aca68-ffd9-4978-90a1-383c6949fa89 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019067 Aug 25 02:59:52.354487 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:52.363648 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-5182be26-0c24-4313-89d8-f3ce619c27a8 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:52.368943 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.wsgi [None req-5182be26-0c24-4313-89d8-f3ce619c27a8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-5182be26-0c24-4313-89d8-f3ce619c27a8 admin admin] Request method failure captured: Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept: application/json Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept-Encoding: gzip, deflate Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Connection: keep-alive Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Content-Length: 0 Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Host: 10.222.0.75 Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-System-Scope: None Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: User-Agent: python-novaclient Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Auth-Token: gAAAAABjBuWnyYpTYkMHVITVHmEJ3fW_HPCYQ9pheA1PUfZTZBK5D9mIKMDWBlWYxyIj0Lb8nwSqjk3Jp5tY2VK43L5hrnkw23-nJy_GCT7PRdo7M1Dki-QVHCG7naJz1F8XRGzDDCrGT4eBIQY1MO7RMkwAG-2LmcNEgtIfPyAxrsJbn3TZ20U Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Id: None Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Name: None Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Identity-Status: Confirmed Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Is-Admin-Project: True Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Id: default Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Name: Default Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Name: admin Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Role: admin,member,reader Aug 25 02:59:52.370437 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Roles: admin,member,reader Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant: admin Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Name: admin Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User: admin Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Id: default Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Name: Default Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Name: admin Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: method: > Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: exception: Flavor 84 could not be found. Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: action_args: {'id': '84'} Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:52.371770 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:52.372653 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:52.374625 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-5182be26-0c24-4313-89d8-f3ce619c27a8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:52.375864 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-5182be26-0c24-4313-89d8-f3ce619c27a8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011653 Aug 25 02:59:52.375864 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Thu Aug 25 02:59:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 02:59:53.344332 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-da4aca68-ffd9-4978-90a1-383c6949fa89 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:53.345369 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-da4aca68-ffd9-4978-90a1-383c6949fa89 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 25 02:59:53.345749 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:53.875825 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-373b7690-6765-427b-82bd-752fc2f2a9e1 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:53.881570 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.wsgi [None req-373b7690-6765-427b-82bd-752fc2f2a9e1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-373b7690-6765-427b-82bd-752fc2f2a9e1 admin admin] Request method failure captured: Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept: application/json Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Accept-Encoding: gzip, deflate Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Connection: keep-alive Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Content-Length: 0 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Host: 10.222.0.75 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Openstack-System-Scope: None Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: User-Agent: python-novaclient Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Auth-Token: gAAAAABjBuWpgRemLhWKCEGU758pbJuwUEYyoJ3ghLnUE-j31Vzjtq_pH-ogOXJ_ad0eW86oDi6NNOHyc8Q8v0PRCOy4N5IiCsq2rT859dbyl1mYex3F0ZxVUu7TIgafVOlQCtpfSwXsBPwdJMhx8JOHRzu-BuYKBT4UC4RS1tTnDRP_JAacTx4 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Id: None Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Domain-Name: None Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Identity-Status: Confirmed Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Is-Admin-Project: True Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Id: default Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Domain-Name: Default Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Project-Name: admin Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Role: admin,member,reader Aug 25 02:59:53.883062 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Roles: admin,member,reader Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant: admin Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-Tenant-Name: admin Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User: admin Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Id: default Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Domain-Name: Default Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: X-User-Name: admin Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: method: > Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: exception: Flavor 451 could not be found. Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: action_args: {'id': '451'} Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:53.884637 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:53.885608 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.887580 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-373b7690-6765-427b-82bd-752fc2f2a9e1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:53.890688 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-373b7690-6765-427b-82bd-752fc2f2a9e1 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395031 Aug 25 02:59:53.890688 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 02:59:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 25 02:59:53.894757 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-b96673a3-706f-49d8-a444-a364eb0a5734 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:53.910247 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-b96673a3-706f-49d8-a444-a364eb0a5734 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019038 Aug 25 02:59:53.910775 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:53.920728 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:53.936645 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018926 Aug 25 02:59:53.937199 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Thu Aug 25 02:59:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 02:59:53.946561 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f5e2d8f2-d4ef-46f4-a93d-fc6087d39f7e admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:53.953038 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.wsgi [None req-f5e2d8f2-d4ef-46f4-a93d-fc6087d39f7e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f5e2d8f2-d4ef-46f4-a93d-fc6087d39f7e admin admin] Request method failure captured: Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept: application/json Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Accept-Encoding: gzip, deflate Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Connection: keep-alive Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Content-Length: 0 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Host: 10.222.0.75 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-Api-Version: compute 2.90 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Openstack-System-Scope: None Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: User-Agent: python-novaclient Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Auth-Token: gAAAAABjBuWpgRemLhWKCEGU758pbJuwUEYyoJ3ghLnUE-j31Vzjtq_pH-ogOXJ_ad0eW86oDi6NNOHyc8Q8v0PRCOy4N5IiCsq2rT859dbyl1mYex3F0ZxVUu7TIgafVOlQCtpfSwXsBPwdJMhx8JOHRzu-BuYKBT4UC4RS1tTnDRP_JAacTx4 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Id: None Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Domain-Name: None Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Identity-Status: Confirmed Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Is-Admin-Project: True Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Openstack-Nova-Api-Version: 2.90 Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Id: default Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Domain-Name: Default Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Project-Name: admin Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Role: admin,member,reader Aug 25 02:59:53.954563 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Roles: admin,member,reader Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eabb40ce2ddb40b4bea318792fc09f8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eabb40ce2ddb40b4bea318792fc09f8e"}]}] Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant: admin Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Id: eabb40ce2ddb40b4bea318792fc09f8e Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-Tenant-Name: admin Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User: admin Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Id: default Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Domain-Name: Default Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Id: ba566fd127094ca6936cf4d2fd42c8e6 Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: X-User-Name: admin Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: method: > Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: exception: Flavor 451 could not be found. Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: action_args: {'id': '451'} Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 02:59:53.956132 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:53.957078 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: ERROR nova.api.openstack.wsgi Aug 25 02:59:53.958143 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f5e2d8f2-d4ef-46f4-a93d-fc6087d39f7e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 02:59:53.959153 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-f5e2d8f2-d4ef-46f4-a93d-fc6087d39f7e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012851 Aug 25 02:59:53.959153 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 02:59:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:54.932504 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:54.933505 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 25 02:59:54.933903 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:55.455429 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-4c8fc609-4c35-4851-8c83-d62f2ed0ed2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:55.523843 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-4c8fc609-4c35-4851-8c83-d62f2ed0ed2e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.451874 Aug 25 02:59:55.524436 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Aug 25 02:59:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:56.501144 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:56.502186 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 25 02:59:56.502586 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:57.032785 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-8677cd06-bdd0-41c6-831f-d45977b5d29e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:57.130617 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-8677cd06-bdd0-41c6-831f-d45977b5d29e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.487399 Aug 25 02:59:57.131174 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Aug 25 02:59:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 02:59:58.101194 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:58.102192 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 25 02:59:58.102585 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 02:59:58.627024 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-254f0db5-aa3c-4c4c-ace6-e7490f0c2629 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 02:59:58.700670 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-254f0db5-aa3c-4c4c-ace6-e7490f0c2629 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.460006 Aug 25 02:59:58.701273 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Aug 25 02:59:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 02:59:59.679553 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 02:59:59.680591 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 25 02:59:59.680989 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 02:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:00:00.210470 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-f943fdfe-3619-49e2-b7a6-415b2555371f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:00:00.282682 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-f943fdfe-3619-49e2-b7a6-415b2555371f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.464595 Aug 25 03:00:00.283233 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Thu Aug 25 02:59:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:00:01.271438 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:01.272738 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 25 03:00:01.273133 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 03:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:00:01.800825 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-1904d920-644b-4f4b-8869-d37609d98c6a admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:01.827008 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-1904d920-644b-4f4b-8869-d37609d98c6a admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413741 Aug 25 03:00:01.827487 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Thu Aug 25 03:00:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:00:55.392383 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:55.393421 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-0f22b891-87a5-4001-ae24-fbee75d7a656 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 25 03:00:55.393823 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 931 bytes} [Thu Aug 25 03:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:00:55.405050 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.916311 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-d0d3179a-ac31-4c1b-a76d-4652ac484b7e admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:55.939981 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-d0d3179a-ac31-4c1b-a76d-4652ac484b7e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.539880 Aug 25 03:00:55.940575 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1292 bytes} [Thu Aug 25 03:00:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:00:55.961774 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG dbcounter [-] [106240] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.966070 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-f042a465-f1bb-4db4-828a-1e4df997c5d1 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:55.973506 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-f042a465-f1bb-4db4-828a-1e4df997c5d1 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013226 Aug 25 03:00:55.974029 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1283 bytes} [Thu Aug 25 03:00:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:55.986601 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-704cccb1-dadc-4fd4-89fb-ae31ff2bc831 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:55.994463 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-704cccb1-dadc-4fd4-89fb-ae31ff2bc831 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011375 Aug 25 03:00:55.995016 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1286 bytes} [Thu Aug 25 03:00:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:00:56.007784 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:56.015435 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011371 Aug 25 03:00:56.015949 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1286 bytes} [Thu Aug 25 03:00:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:00:56.028222 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-c175f022-9a80-4c61-8bfa-bd80a6eaefa8 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:00:56.035862 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-c175f022-9a80-4c61-8bfa-bd80a6eaefa8 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011415 Aug 25 03:00:56.036448 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1283 bytes} [Thu Aug 25 03:00:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:04:06.063130 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:06.067614 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 25 03:04:06.067614 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 03:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:04:06.206333 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=6 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:06.365091 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:06.368490 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:06.368953 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:06.369374 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:06.370069 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:06.370497 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:06.370899 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:06.444564 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-da5a7455-fb52-4cd4-ad8d-ed1eba33b6f0 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.239676 Aug 25 03:04:06.445131 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 03:04:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:04:07.281413 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:07.282415 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 25 03:04:07.282804 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 03:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:04:07.488317 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:07.491631 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:07.492163 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:07.492603 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:07.493296 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:07.493730 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:07.494136 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:07.517701 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-3d68e114-703a-44eb-be90-ceda8b07a637 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082172 Aug 25 03:04:07.518291 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 03:04:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 03:04:18.769387 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:18.770398 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 25 03:04:18.770790 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 03:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:04:18.913752 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell0:SELECT=4 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:18.914687 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_cell1:SELECT=4 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:18.915193 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG dbcounter [-] [106239] Writing DB stats nova_api:SELECT=8 {{(pid=106239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:18.965212 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:18.968958 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:18.969482 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:18.969898 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:18.970621 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:18.971063 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:18.971470 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:18.997374 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-cb27b297-8c8e-4170-9055-3aae67e4c631 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088044 Aug 25 03:04:18.998582 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 03:04:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:04:19.829945 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: DEBUG nova.api.openstack.wsgi [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] Calling method '>' {{(pid=106240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:19.830974 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: INFO nova.api.openstack.requestlog [None req-c2596f69-0a1e-4c9e-a94a-504b64e462d6 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 25 03:04:19.831365 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: [pid: 106240|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Thu Aug 25 03:04:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:04:20.024023 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG nova.api.openstack.wsgi [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Calling method '>' {{(pid=106239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:04:20.027464 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:20.027963 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:20.028410 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:20.029498 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:04:20.029936 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:04:20.030348 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: DEBUG oslo_concurrency.lockutils [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:04:20.051858 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: INFO nova.api.openstack.requestlog [None req-af4214a1-6b2b-4e31-8a54-297fae9a6c17 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080988 Aug 25 03:04:20.052373 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: [pid: 106239|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Thu Aug 25 03:04:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:05:17.990732 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: Thu Aug 25 03:05:17 2022 - graceful shutdown triggered... Aug 25 03:05:17.991257 dv-cinder-779578-6-iscsi devstack@n-api.service[106240]: Gracefully killing worker 2 (pid: 106240)... Aug 25 03:05:17.991642 dv-cinder-779578-6-iscsi devstack@n-api.service[106239]: Gracefully killing worker 1 (pid: 106239)... Aug 25 03:05:17.992752 dv-cinder-779578-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 25 03:05:18.991808 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: worker 1 buried after 1 seconds Aug 25 03:05:18.991808 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: worker 2 buried after 1 seconds Aug 25 03:05:18.991808 dv-cinder-779578-6-iscsi devstack@n-api.service[106238]: goodbye to uWSGI. Aug 25 03:05:18.993331 dv-cinder-779578-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 25 03:05:18.993893 dv-cinder-779578-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 25 03:05:18.996795 dv-cinder-779578-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 25 03:05:19.005817 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 03:05:19 2022] *** Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: nodename: dv-cinder-779578-6-iscsi Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: machine: x86_64 Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: clock source: unix Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: pcre jit disabled Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: detected number of CPU cores: 4 Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: current working directory: / Aug 25 03:05:19.007788 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: detected binary path: /usr/bin/uwsgi-core Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: your processes number limit is 47680 Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: your memory page size is 4096 bytes Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: detected max file descriptor number: 2048 Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: lock engine: pthread robust mutexes Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: thunder lock: enabled Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 25 03:05:19.008598 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 03:05:19.049511 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: Python main interpreter initialized at 0x5588163269c0 Aug 25 03:05:19.049511 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: python threads support enabled Aug 25 03:05:19.049511 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: your server socket listen backlog is limited to 100 connections Aug 25 03:05:19.049511 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: your mercy for graceful operations on workers is 90 seconds Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: *** Operational MODE: preforking *** Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: *** uWSGI is running in multiple interpreter mode *** Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: spawned uWSGI master process (pid: 121240) Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: spawned uWSGI worker 1 (pid: 121255, cores: 1) Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: spawned uWSGI worker 2 (pid: 121256, cores: 1) Aug 25 03:05:19.061171 dv-cinder-779578-6-iscsi devstack@n-api.service[121240]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 03:05:19.050429 dv-cinder-779578-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 25 03:05:19.716160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:05:19.726099 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 25 03:05:20.877657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:05:20.877657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: from cryptography.utils import int_from_bytes Aug 25 03:05:20.878398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:05:20.878398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: from cryptography.utils import int_from_bytes Aug 25 03:05:20.903286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:05:20.903286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: from cryptography.utils import int_from_bytes Aug 25 03:05:20.903832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 03:05:20.903832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: from cryptography.utils import int_from_bytes Aug 25 03:05:23.313973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:05:23.314561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:05:23.314773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:05:23.315134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:05:23.315386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:05:23.315775 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.316097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.316447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.316763 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.317249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.317558 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.317884 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.318203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.318528 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.318787 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.319101 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.319422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-6-iscsi {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.319741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.320046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.320383 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.320704 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.321007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.321325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.321641 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.322148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.323362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.323362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.323362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.323648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.324458 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.324746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.325077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.325485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.325818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.326127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.326535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-6-iscsi {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.326854 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.327167 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.327547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.327991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.328361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.328665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.328979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.329302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.329611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.329936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.330253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.330570 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.330889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.331194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.331501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.331813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.332210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.332448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.332914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.333317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.333796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.334281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.334683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.335095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.335226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.335410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.335766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.336242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.336554 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.336861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.337167 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.337474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.337779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.338083 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.338385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.338685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.339002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.339335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.340467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.340913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.341233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.341646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.341898 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.342212 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.342556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.342874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.343182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.343498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.343823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.344127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.344568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.344874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.345195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.345527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.345829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.346079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.346378 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.346679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.346993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.347297 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.347599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.347898 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.348218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.348523 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.348823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.349127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.349434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.349734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.350035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.350336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.350638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.350938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.351254 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.351568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.351870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.352266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.352571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.353023 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.353986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.353986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.353986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.354241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.354545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.354849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.355206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.355510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.355816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.356132 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.356456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.356755 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.357068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.357373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.357676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.357974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.358532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.358990 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.359300 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.359607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.359911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.360325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.360552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.360871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.361176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.361479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.361781 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.362094 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.362430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.362762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.363100 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.363418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.363748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.364075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.364419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.364729 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.365039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.365359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.365666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.365976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.366284 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.366598 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.366912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.367238 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.367551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.367661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 03:05:23.368107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.368333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 03:05:23.368505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.368682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 03:05:23.368864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.368864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.369153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 03:05:23.369153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 03:05:23.369438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.369438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.369735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.369903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.370051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.370196 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.370349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.370495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.370655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.370809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.370956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.371103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.371670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.371850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.372002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.372167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.372368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.372529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.372683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.372860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.373015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.373162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.373316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.373469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.373622 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.373820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779578-6-iscsi {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.373972 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.374123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.374270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.374519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.374673 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.374834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.374987 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.375140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.375287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.375440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.375610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.375767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.375912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.376058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.376304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.376471 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.376657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.376805 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.376957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.377102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.377246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.377406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.377552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.377552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.377834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.377986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.378139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.378304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.378459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.378611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.378756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.378901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.379055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.379209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.379354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.379511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.379665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.379811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.379970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779578-6-iscsi {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.380117 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.380316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.380472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.380618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.380763 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.380917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.381072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.381072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.381355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.381815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.381981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.382136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.382282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.382438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.382700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.382863 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.383019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.383172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.383324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.383471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.383623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.383770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.383974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.384120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.384319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.384466 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.384634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.384795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.384947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.385093 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.385238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.385389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.385569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.387138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.387345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.387507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.387662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.387808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.387976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.388135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.388318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.388474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.388628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.388774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.388920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.389078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.389232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.389377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.389522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.389522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.389832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.389979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.390134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.390287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.390433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.390578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.390734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.390880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.391033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.391185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.391336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.391498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.391667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.392122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.392294 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.392458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.392612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.392871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.393032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.393188 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.393342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.393496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.393650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.393809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.393997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.394171 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.394327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.394327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.394614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.394838 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.395003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.395161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.395431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.395593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.395750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.395896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.396051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.396214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.396379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.396535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.396689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.396836 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.396991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.397144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.397484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.397648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.397796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.397955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.398112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.398265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.398422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.398580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.398734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.398893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.399047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.399201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.399353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.399499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.399644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.399798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.399951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.399951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.400273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.400432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.400592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.400747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.400901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.401053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.401206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.401359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.401515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.401668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.401841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.403016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.403180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.403335 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.403492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.403651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.403796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.403950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.404193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.404362 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.404522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.404676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.404821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.404974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.405128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.405281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.405449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.405608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.405755 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.405917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.406070 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.406224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.406379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.406525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.406677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.406824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.406969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.407122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.407268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.407420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.407577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.407730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.407885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.408078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.408258 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.408406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.408566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.408719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.408874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.409027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.409180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.409326 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.409486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.409687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.409840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.409999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.410156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.410310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.410471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.410618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.410764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.410917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.411082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.411692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.411864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.412040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.412349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.412503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.412650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.413059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.413308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.413467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.413615 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.413769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.413916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.414122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.414275 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.414422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.414576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.414741 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.414889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.415049 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.415204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.415358 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.415512 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.415873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.416035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.416293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.416450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.416604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.416751 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.416916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.417077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.417225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.417386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.417541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.417778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.417941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.418097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.418252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 03:05:23.418407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.418561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.418707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.418860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.419931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.420239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.420390 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.420535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.420692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.420845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421301 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421456 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.421918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.422063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.422208 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.422370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.422601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.422764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.423167 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.423346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.423582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.423817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.423974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.424127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.424340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.424498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.424646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.425058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.425524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.425690 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.425837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426157 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.426940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.427842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428157 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428488 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428786 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.428944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.429833 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430443 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.430911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.431964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432321 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.432882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.433580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.433580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.433977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434125 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.434953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435411 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435565 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.435857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.436850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437150 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.437918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.438614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.438782 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.438939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439763 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.439910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440384 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.440843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.441849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442006 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.442772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.443016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.443284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.443829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.444640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.444801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.444949 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445706 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.445998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.446910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447666 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.447820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.448126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.448299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.448455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.448610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.449270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.449437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.449584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.449739 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.449897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.450906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451198 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.451945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452615 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.452933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.453206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.453462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.453820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.453991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.454152 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.454313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.454475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.454769 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.454937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.455092 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.455244 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.455414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.455650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.455823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.456594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.456762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.456930 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457554 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.457879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458381 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458534 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.458845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.459994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.460336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.460499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.460499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.460807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.460960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461750 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.461912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.462855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.463014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.463193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.463437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.463680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.464011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.464191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.464350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.465357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.465594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.465765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.465927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.466899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.467857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468190 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.468958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469761 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.469922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.470873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.471844 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472361 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472523 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.472846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.473006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.473173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.473326 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.473575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.473820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.474980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.475133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.475348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.475648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.475808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.475963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.476124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.476378 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.476545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.476716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.476716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.477955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.478255 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.478416 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.478584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.478749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.478901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.479993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.480208 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.480389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.480561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.480726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.480880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481660 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.481970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.482913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.483067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.483379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.483571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.483776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.484058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.484468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.484638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.484802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.484955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.485108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.485269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.485503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.486320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.486495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.486495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.486803 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.486958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.487901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.488992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.489895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490395 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490706 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.490867 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.491665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.492034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.492224 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.493315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.493493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.493661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.493818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.493972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.494946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.495360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.495568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.495778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.495943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.496097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.496371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.496790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.496953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.497127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.497289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.497450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.497685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.497865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498204 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.498762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499701 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.499861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500730 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.500894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501060 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501383 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.501862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502186 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502510 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502678 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.502851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503807 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.503967 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.504128 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.504437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.504437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.504820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.504987 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.505139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.505293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.505591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.505761 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.505925 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506720 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.506993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507615 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507774 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.507936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.508128 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.508337 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.508499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.508652 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.508886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509383 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509537 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.509865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.510956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.511058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.511159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.511795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.511895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.511979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512753 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.512922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513705 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.513939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514227 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.514975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.515957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516465 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516863 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.516937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517417 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517880 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.517953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518351 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518653 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518653 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.518801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519224 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519397 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519706 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.519935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520311 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520530 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.520972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521128 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521208 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.521921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522167 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522539 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522847 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.522921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523218 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523690 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.523998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.524949 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525283 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525652 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.525965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526843 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.526948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.527059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.527059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.527717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528647 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528728 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528887 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.528887 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.529921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530003 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.530800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.531940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.532087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.532281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.534824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535202 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535283 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.535976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.536903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.537862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.538041 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.538300 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.538483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.538719 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.538877 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.539037 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.539295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.539576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.539746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.539928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.540977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541452 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.541941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.542095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.542256 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.542423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.542659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.542659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.543984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.544965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545598 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545761 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.545968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.546276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.546438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.546599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.546769 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.546926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547744 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.547905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.548066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.548296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.548542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.548725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.548889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.549044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.549197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.549445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.549714 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.549884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.550969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.551926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.552903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553374 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.553869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554445 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.554944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.555097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.555392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.555562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.555719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.555719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.556934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557251 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.557908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.558073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.558885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.559061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.559218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.559463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.559712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.559959 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.560119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.560577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.560734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.560889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.561042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.561196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.561373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.561543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.561698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.562430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.562596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.562760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.562926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.563859 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.564870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.565969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.566172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.566354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.566522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.566689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.566853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567326 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.567943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.568114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.568470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.568645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.568802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569248 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.569978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.570236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.570406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.570562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.570725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.570892 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571740 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.571901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.572976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.573140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.573295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.573461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.573623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.573826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.574031 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.575311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.575613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.575785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.575953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.575953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.576399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.576566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.576744 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.576908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577101 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577442 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.577938 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.578105 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.578267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.578449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.578695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.578864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.579983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.580252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.580431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.580699 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.580860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581351 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581807 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.581971 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582125 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.582927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.583888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121255) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.584868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.586154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.587411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.588680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.590024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.591973 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.592330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.592651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.593011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.593359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.593681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.594009 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.594352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.594669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.595023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.595343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.595911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.596272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.596605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.596950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.597289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.597604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.597917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.598227 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.598576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.598924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.599243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.599583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.599854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.600321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.600591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.600909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.601225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.601559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.601896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.602211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.602533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.602871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.603186 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.603506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.603854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.604255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.604541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.604863 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.605232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.605547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.605857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.606174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.606511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.606825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.607191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.607517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.607828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.608282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.608601 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.608927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.609257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.609577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.609903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.610230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.610548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.610902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.611229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.611568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.611916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.612292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.612637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.612979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.613291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.613600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.613917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.614239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.614551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.614859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.615303 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.615621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.615930 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.616265 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.616603 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.616887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.617202 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.617541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.617816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.618145 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.618479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.618788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.619151 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.619472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.619779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.620090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.620422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.621357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.621712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.622118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.622467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.622790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.623118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.623435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.623762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.624076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.624433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.624782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.625110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.625424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.625788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.626109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.626427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.626742 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.627061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.627400 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.627717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.628052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.628445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.628760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.629090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.629486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.629739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.630071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.630435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.630773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.631088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.631487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.631719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.632034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.632377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.632701 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.633016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.633332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.633654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.633973 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.634304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.634635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.634952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.635283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.635613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.636287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.637332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.637691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.638047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.638370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.638688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.638998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 03:05:23.639246 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121256) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 03:05:23.644960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO dbcounter [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Registered counter for database nova_api Aug 25 03:05:23.665428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_db.sqlalchemy.engines [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.672126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writer thread running {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.702148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO dbcounter [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Registered counter for database nova_api Aug 25 03:05:23.722355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.728942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writer thread running {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.730338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.context [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),429328db-c6b7-4f53-8dd7-047f5c486dbd(cell1) {{(pid=121255) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:05:23.734648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:05:23.735127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:05:23.736775 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:05:23.737517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:05:23.737971 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:05:23.739963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:05:23.742227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO dbcounter [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Registered counter for database nova_cell0 Aug 25 03:05:23.746881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO dbcounter [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Registered counter for database nova_cell1 Aug 25 03:05:23.754434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_db.sqlalchemy.engines [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.756809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_db.sqlalchemy.engines [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.763108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writer thread running {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.764813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writer thread running {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.786692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.context [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),429328db-c6b7-4f53-8dd7-047f5c486dbd(cell1) {{(pid=121256) load_cells /opt/stack/nova/nova/context.py:464}} Aug 25 03:05:23.790820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:05:23.791293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:05:23.792998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:05:23.793814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:05:23.794293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:05:23.796318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:05:23.798318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO dbcounter [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Registered counter for database nova_cell0 Aug 25 03:05:23.802449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO dbcounter [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Registered counter for database nova_cell1 Aug 25 03:05:23.810599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.815197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.818174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writer thread running {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.916288 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO dbcounter [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Registered counter for database nova_cell0 Aug 25 03:05:23.924231 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_db.sqlalchemy.engines [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121255) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.929147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writer thread running {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.960319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writer thread running {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:23.970285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO dbcounter [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Registered counter for database nova_cell0 Aug 25 03:05:23.979073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_db.sqlalchemy.engines [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121256) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 03:05:23.984399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writer thread running {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 03:05:24.250872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: WARNING keystonemiddleware.auth_token [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:05:24.258172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: WARNING keystonemiddleware.auth_token [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:05:24.303487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: WARNING keystonemiddleware.auth_token [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:05:24.311525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: WARNING keystonemiddleware.auth_token [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:05:24.620307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: WARNING keystonemiddleware.auth_token [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:05:24.629920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: WARNING keystonemiddleware.auth_token [None req-d4df4c1d-9034-4bc9-a9b7-281d18c3c7c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:05:24.636040 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588163269c0 pid: 121255 (default app) Aug 25 03:05:24.661857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: WARNING keystonemiddleware.auth_token [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 25 03:05:24.668721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: WARNING keystonemiddleware.auth_token [None req-3ef46ad3-3530-47ab-9671-d9260fc3e85d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 25 03:05:24.674092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5588163269c0 pid: 121256 (default app) Aug 25 03:06:00.972011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:00.973031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:00.974025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:00.974798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:02.162281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:02.164228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:02.165510 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:02.166604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:02.383516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8ea20954-2d45-4365-8634-223349076083 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Action: 'create', calling method: .version_select at 0x7ff198abbaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-330696678", "metadata": {"Type": "work"}}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:02.980028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-38c6abb3-8c40-46d1-9d5b-b69b5559a8eb tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Action: 'create', calling method: .version_select at 0x7ff198abbaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1639666266", "metadata": {"Type": "work"}}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-38c6abb3-8c40-46d1-9d5b-b69b5559a8eb tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 122 Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:03.000130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1639666266", "metadata": {"Type": "work"}}} Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:03.001874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1639666266', 'metadata': {'Type': 'work'}}}} Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi '#$%' Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:03.003250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:06:03.004845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:06:03.006312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 25 03:06:03.006312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.007263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-38c6abb3-8c40-46d1-9d5b-b69b5559a8eb tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:03.008271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-38c6abb3-8c40-46d1-9d5b-b69b5559a8eb tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.861181 Aug 25 03:06:03.015495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1156 bytes} [Thu Aug 25 03:06:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 863 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 25 03:06:03.024058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8994c149-65bd-47f0-a639-1ec43d0c1717 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Action: 'create', calling method: .version_select at 0x7ff198abbb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-308942230", "metadata": {"Type": "work"}}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8994c149-65bd-47f0-a639-1ec43d0c1717 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 119 Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:03.028459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-308942230", "metadata": {"Type": "work"}}} Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:03.029957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-308942230', 'metadata': {'Type': 'work'}}}} Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi '0' Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:03.030898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:06:03.033051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:06:03.034353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 25 03:06:03.034353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.042843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8994c149-65bd-47f0-a639-1ec43d0c1717 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:03.043850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8994c149-65bd-47f0-a639-1ec43d0c1717 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023794 Aug 25 03:06:03.044906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 2/2] 10.222.0.75 () {60 vars in 1156 bytes} [Thu Aug 25 03:06:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:06:03.058263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1de2dede-0984-4705-9cd4-9a918ae96e9e tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Action: 'create', calling method: .version_select at 0x7ff198979670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1737358450", "metadata": {"Type": "work"}}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1de2dede-0984-4705-9cd4-9a918ae96e9e tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 119 Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:03.065760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1737358450", "metadata": {"Type": "work"}}} Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:03.067367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1737358450', 'metadata': {'Type': 'work'}}}} Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise error Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi '' Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:03.075812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 25 03:06:03.077649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 25 03:06:03.079008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 25 03:06:03.079008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.079008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1de2dede-0984-4705-9cd4-9a918ae96e9e tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:03.079008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1de2dede-0984-4705-9cd4-9a918ae96e9e tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020432 Aug 25 03:06:03.079008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 3/3] 10.222.0.75 () {60 vars in 1156 bytes} [Thu Aug 25 03:06:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:06:03.084911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9022aa04-4f90-4104-99db-55c00cc5063d tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Calling method '.version_select at 0x7ff198979e50>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:03.768651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-9022aa04-4f90-4104-99db-55c00cc5063d tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] HTTP exception thrown: Volume tempest-invalid-98958607 could not be found. Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9022aa04-4f90-4104-99db-55c00cc5063d tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-98958607 HTTP/1.1 Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:03.774847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Volume tempest-invalid-98958607 could not be found. Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'tempest-invalid-98958607'} Aug 25 03:06:03.777483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-98958607 could not be found. (HTTP 404) (Request-ID: req-e0472b63-5e7c-4a3b-a372-cf7ece079e80) Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.778408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:06:03.779810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-98958607 could not be found. Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:06:03.781170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-98958607 could not be found. Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-98958607 could not be found. Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9022aa04-4f90-4104-99db-55c00cc5063d tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 404 to user: Volume tempest-invalid-98958607 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:03.782493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9022aa04-4f90-4104-99db-55c00cc5063d tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-98958607" status: 404 len: 97 microversion: 2.1 time: 0.694335 Aug 25 03:06:03.784440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 4/4] 10.222.0.75 () {58 vars in 1212 bytes} [Thu Aug 25 03:06:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-98958607 => generated 97 bytes in 707 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:06:03.799018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-654194c1-7077-4df3-9bcf-5c7b9004d258 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009861 Aug 25 03:06:03.800094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 5/5] 10.222.0.75 () {58 vars in 1140 bytes} [Thu Aug 25 03:06:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 25 03:06:03.808664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4062e205-8726-4cbe-98ed-fa3594cab8fe tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003863 Aug 25 03:06:03.810092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 6/6] 10.222.0.75 () {58 vars in 1137 bytes} [Thu Aug 25 03:06:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 25 03:06:03.834731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-578fbc62-27d0-4768-a161-a489ce588403 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Calling method '.version_select at 0x7ff1989299d0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:03.969378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-578fbc62-27d0-4768-a161-a489ce588403 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] HTTP exception thrown: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-578fbc62-27d0-4768-a161-a489ce588403 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/os-volumes/067548dc-a168-4a7a-a2de-e95cda291635 HTTP/1.1 Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:03.972240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '067548dc-a168-4a7a-a2de-e95cda291635'} Aug 25 03:06:03.973757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. (HTTP 404) (Request-ID: req-faa22bb2-fe83-4c70-bba1-70039181526b) Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.974637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:06:03.976487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:06:03.977787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. Aug 25 03:06:03.979673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:03.982337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-578fbc62-27d0-4768-a161-a489ce588403 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 404 to user: Volume 067548dc-a168-4a7a-a2de-e95cda291635 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:03.982848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-578fbc62-27d0-4768-a161-a489ce588403 tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/067548dc-a168-4a7a-a2de-e95cda291635" status: 404 len: 109 microversion: 2.1 time: 0.151721 Aug 25 03:06:03.984091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 7/7] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:06:03 2022] DELETE /compute/v2.1/os-volumes/067548dc-a168-4a7a-a2de-e95cda291635 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:06:03.995888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-79eeb149-12ce-48d5-8eb1-5e36a06a7f1b tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Calling method '.version_select at 0x7ff198929280>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:04.273766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-79eeb149-12ce-48d5-8eb1-5e36a06a7f1b tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] HTTP exception thrown: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-79eeb149-12ce-48d5-8eb1-5e36a06a7f1b tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Request method failure captured: Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/os-volumes/e71430ca-76da-4755-b7a8-64574c448d74 HTTP/1.1 Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuca5q9IzgmUlAAUQAXmb6TkwHfaXaPz3UUjSDiuQqSo7NyaLBbcEHUSpAJHxjcEH-N4vgYeyS06s0Y3-CCnI3TsGBRH0ca560MwGBLrraaZtag73NtTVtOJu-wj13ScXmJ2OYPDxNQAqbzleNjDndbEnk7zazD_NdZfJUMkAQRLipw Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:06:04.277902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/44ad45bb838d4a27a8c085b28b5a227d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_44ad45bb838d4a27a8c085b28b5a227d"}]}] Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 44ad45bb838d4a27a8c085b28b5a227d Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesNegativeTest-702906723 Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 94a5fef1b4394d4b81d5ac52e94b6bf2 Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesNegativeTest-702906723-project Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'e71430ca-76da-4755-b7a8-64574c448d74'} Aug 25 03:06:04.610901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. (HTTP 404) (Request-ID: req-62f3db99-9c47-443e-abbe-6df7aa610ec6) Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:04.622346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:06:04.627420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:06:04.634170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-79eeb149-12ce-48d5-8eb1-5e36a06a7f1b tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] Returning 404 to user: Volume e71430ca-76da-4755-b7a8-64574c448d74 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-79eeb149-12ce-48d5-8eb1-5e36a06a7f1b tempest-VolumesNegativeTest-702906723 tempest-VolumesNegativeTest-702906723-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/e71430ca-76da-4755-b7a8-64574c448d74" status: 404 len: 109 microversion: 2.1 time: 0.290984 Aug 25 03:06:04.638909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 8/8] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:03 2022] GET /compute/v2.1/os-volumes/e71430ca-76da-4755-b7a8-64574c448d74 => generated 109 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:06:04.640786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8ea20954-2d45-4365-8634-223349076083 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.502505 Aug 25 03:06:04.640786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 1/9] 10.222.0.75 () {60 vars in 1156 bytes} [Thu Aug 25 03:06:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3505 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 03:06:04.641472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8475610c-23ed-484f-8a70-0366ff9c661e tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff198929790>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:04.641472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8475610c-23ed-484f-8a70-0366ff9c661e tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 200 len: 352 microversion: 2.1 time: 0.122259 Aug 25 03:06:04.641472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 9/10] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:04 2022] GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:05.614134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b5f2bd83-42b6-41c0-919b-648f0d47ef7f tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff198994940>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:05.690858 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b5f2bd83-42b6-41c0-919b-648f0d47ef7f tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 200 len: 353 microversion: 2.1 time: 0.081710 Aug 25 03:06:05.692523 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 2/11] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:05 2022] GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:05.704401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f30033d5-dac1-44e4-9905-572c8322bb89 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff198929160>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:05.788884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f30033d5-dac1-44e4-9905-572c8322bb89 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 200 len: 353 microversion: 2.1 time: 0.088322 Aug 25 03:06:05.789490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 10/12] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:05 2022] GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:05.805456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-555569db-60ec-495e-be6e-c5f41a02c7ec tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff1989ab040>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:06.204216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-555569db-60ec-495e-be6e-c5f41a02c7ec tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 202 len: 0 microversion: 2.1 time: 0.403015 Aug 25 03:06:06.204934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 3/13] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:06:05 2022] DELETE /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:06:06.212114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bc2a96b0-9fe7-472e-8420-cee8a400ce80 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff19897f4c0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:06.304845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bc2a96b0-9fe7-472e-8420-cee8a400ce80 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 200 len: 352 microversion: 2.1 time: 0.096249 Aug 25 03:06:06.305405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 11/14] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:06 2022] GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:06:07.318885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a6693686-320c-4bde-bcdf-f3f6b722f7f9 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Calling method '.version_select at 0x7ff1989ab700>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:07.387116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-a6693686-320c-4bde-bcdf-f3f6b722f7f9 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] HTTP exception thrown: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a6693686-320c-4bde-bcdf-f3f6b722f7f9 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Request method failure captured: Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c HTTP/1.1 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBucYaAgpDTNbllkRCH9VXeInJeP_dzGm3lohRlzwpkBhLqjrZ-gsuam-Kq3PMdAVkfTjFR6uRrxRGwACka1TM8jYyVIAXOPeroO5bwNrp60j2NN-x68FJc1fK90FYmy31g7mYsy36S1FcjMQcheZNKgv3TR6IPgFkftPO4uzIn8hP5I Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: af2fb18a62fc4528955820da1bb6a409 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-VolumesGetTestJSON-2110379074 Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:06:07.391151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/af2fb18a62fc4528955820da1bb6a409"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/af2fb18a62fc4528955820da1bb6a409"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/af2fb18a62fc4528955820da1bb6a409"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_af2fb18a62fc4528955820da1bb6a409"}]}] Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-VolumesGetTestJSON-2110379074 Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: af2fb18a62fc4528955820da1bb6a409 Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-VolumesGetTestJSON-2110379074 Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-VolumesGetTestJSON-2110379074-project Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 4b694ae9029848f683d475646e7cd589 Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-VolumesGetTestJSON-2110379074-project Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '35dc0b3d-3f55-4676-a1ea-e34ebe3f148c'} Aug 25 03:06:07.392186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. (HTTP 404) (Request-ID: req-a72386a7-6b58-4ab5-baee-12e2d9962cb2) Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:07.392988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:06:07.393825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:06:07.395252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a6693686-320c-4bde-bcdf-f3f6b722f7f9 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] Returning 404 to user: Volume 35dc0b3d-3f55-4676-a1ea-e34ebe3f148c could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a6693686-320c-4bde-bcdf-f3f6b722f7f9 tempest-VolumesGetTestJSON-2110379074 tempest-VolumesGetTestJSON-2110379074-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c" status: 404 len: 109 microversion: 2.1 time: 0.078589 Aug 25 03:06:07.396103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 4/15] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:07 2022] GET /compute/v2.1/os-volumes/35dc0b3d-3f55-4676-a1ea-e34ebe3f148c => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:06:12.992772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f0295243-af0d-42d7-a856-8f301f85b5fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: .version_select at 0x7ff1988ba550>, body: {"keypair": {"name": "tempest-keypair-22582877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDd7614QAdmMwyG6F/xSv6YEGEZxriiS6xdOgQa9pamCZ33MZeG7QklqCB3jT3jf+ORCrzZWuIdZErNIQLVS4sYxeOBmW6Fa0S/4QgCotUwgam5lrZ8hJnxSSbYoVRe7A=="}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:13.102220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-f0295243-af0d-42d7-a856-8f301f85b5fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:13.117569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-f0295243-af0d-42d7-a856-8f301f85b5fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for user fe93db6503a143ab9ed50fedbc8f010f and project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:13.366867 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f0295243-af0d-42d7-a856-8f301f85b5fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.600008 Aug 25 03:06:13.367461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 12/16] 10.222.0.75 () {62 vars in 1200 bytes} [Thu Aug 25 03:06:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 601 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 03:06:17.049380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e7e6ad8e-f88f-4c3c-9662-f0f85e0b2f2b tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff198913040>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:17.160974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e7e6ad8e-f88f-4c3c-9662-f0f85e0b2f2b tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/7be0f9f9-edb9-4aae-bdae-2e9c83990d8b" status: 200 len: 350 microversion: 2.1 time: 0.118577 Aug 25 03:06:17.161841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 5/17] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:17 2022] GET /compute/v2.1/os-volumes/7be0f9f9-edb9-4aae-bdae-2e9c83990d8b => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:18.675955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1316991429", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:18.814341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] validate_networks() for [('e41fd9c3-0d17-460e-a746-06b7f7aecf81', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:06:19.598837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e2288324-02a8-47d9-8ecc-c24f57af7384 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff198913700>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:19.690549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e2288324-02a8-47d9-8ecc-c24f57af7384 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/03dcb70b-6be8-4830-8ef1-9b9afe839c31" status: 200 len: 351 microversion: 2.1 time: 0.095720 Aug 25 03:06:19.691510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 6/18] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:19 2022] GET /compute/v2.1/os-volumes/03dcb70b-6be8-4830-8ef1-9b9afe839c31 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:20.977197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-821525508", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "networks": [{"uuid": "1bd9314a-0d30-442f-b8e5-916b0604ffe1"}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:21.097737 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] validate_networks() for [('1bd9314a-0d30-442f-b8e5-916b0604ffe1', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:06:21.741275 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:06:21.745492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:06:21.749006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:06:21.749006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:06:21.749006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:06:21.772900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:21.773612 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:21.776720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:21.779845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:21.782519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:21.783356 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:21.886923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:21.901106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for user 7daac509316048ec903a5d78d3586aad and project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:21.925732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:06:21.929056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:06:22.132888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a28cc20a-6dfb-406e-9ac9-92bdbcac002a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.843599 Aug 25 03:06:22.134387 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 13/19] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:06:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:06:22.147501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-db1e164d-9bfc-4560-9272-007bc36c3132 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff1987e30d0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:22.310522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-db1e164d-9bfc-4560-9272-007bc36c3132 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/a55f6903-08e5-43cc-b9ba-a559c9263f77" status: 200 len: 351 microversion: 2.1 time: 0.174669 Aug 25 03:06:22.314349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 14/20] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:06:22 2022] GET /compute/v2.1/os-volumes/a55f6903-08e5-43cc-b9ba-a559c9263f77 => generated 351 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:23.045936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:06:23.046450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:06:23.047248 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:06:23.047248 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:06:23.047639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:06:23.075473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:23.075968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:23.076603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:23.077473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:23.078058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:23.078643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:23.132077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d2a77ddf-a353-4244-ac17-5f813059a340 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: .version_select at 0x7ff1987e3790>, body: {"keypair": {"name": "tempest-keypair-1669693590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6oAQ792Sx3z9EJdD+7eGCcSfhNLFwqsyGQxYM6b7p5nYhCTlj3+ths1YdtpiQJ4Kw4RLkgPnqIUTO/T1CgJfPGm0qGClnEj9TEu68wDhP2RipinT6OWVeSClvxRMH6xQ=="}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:23.146663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Getting quotas for project eeb0f7283fb84ea48fd468f22c721b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:23.160197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Getting quotas for user 4529d06c4eda48f788ce7c0327366377 and project eeb0f7283fb84ea48fd468f22c721b8b. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:23.170618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-d2a77ddf-a353-4244-ac17-5f813059a340 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:23.178961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-d2a77ddf-a353-4244-ac17-5f813059a340 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for user 804df9333a474723968f97eb9d6bfc69 and project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:23.187455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:06:23.190908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:06:23.403215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d2a77ddf-a353-4244-ac17-5f813059a340 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.086831 Aug 25 03:06:23.411114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 15/21] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:06:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:23.412201 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-60e3eea7-4640-4299-92fc-59bdfaaa50e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:23.412855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-60e3eea7-4640-4299-92fc-59bdfaaa50e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:23.499004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6feffc1c-becd-43d1-845b-55027b56874a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.345955 Aug 25 03:06:23.510616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 7/22] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:06:23.517953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-60e3eea7-4640-4299-92fc-59bdfaaa50e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:23.522673 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4fab134c-38ef-40cf-b28b-f6b650f6f3e7 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff193fde4c0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:23.552575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-60e3eea7-4640-4299-92fc-59bdfaaa50e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1222 microversion: 2.1 time: 0.146519 Aug 25 03:06:23.553180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 16/23] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:23 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:23.570389 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-654540428", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ac69087-e8de-47de-ba66-364375da66dd"}], "security_groups": [{"name": "tempest-securitygroup--1724012503"}], "key_name": "tempest-keypair-22582877", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:23.682572 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4fab134c-38ef-40cf-b28b-f6b650f6f3e7 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.169637 Aug 25 03:06:23.683428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 8/24] 10.222.0.75 () {58 vars in 1134 bytes} [Thu Aug 25 03:06:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:23.688584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-aa937fd7-7767-4cfe-93fb-483e0707d622 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:23.689205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-aa937fd7-7767-4cfe-93fb-483e0707d622 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:23.893136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] validate_networks() for [('6ac69087-e8de-47de-ba66-364375da66dd', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:06:23.972841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-aa937fd7-7767-4cfe-93fb-483e0707d622 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:24.000384 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-aa937fd7-7767-4cfe-93fb-483e0707d622 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1214 microversion: 2.1 time: 0.315731 Aug 25 03:06:24.011220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 9/25] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:23 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1214 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:24.025637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-26eea755-57a0-40b5-92ef-0b02e006bd5b tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff193ff8310>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:24.247447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-26eea755-57a0-40b5-92ef-0b02e006bd5b tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.233939 Aug 25 03:06:24.247926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 10/26] 10.222.0.75 () {58 vars in 1149 bytes} [Thu Aug 25 03:06:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:24.275683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1005715724", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:24.376012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] validate_networks() for [('e41fd9c3-0d17-460e-a746-06b7f7aecf81', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:06:24.965182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:06:24.965804 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:06:24.966779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:06:24.968120 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:06:24.968748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:06:24.989399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:24.993877 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:24.994944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:24.996002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:24.998294 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:24.998922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:25.060697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:25.071222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for user fe93db6503a143ab9ed50fedbc8f010f and project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:25.101855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:06:25.106984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:06:25.308248 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:06:25.308749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:06:25.309203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:06:25.309758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:06:25.310185 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:06:25.348345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:25.348345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:25.348345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:25.348345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:25.348643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:25.348643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:25.362129 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:25.366744 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for user 7daac509316048ec903a5d78d3586aad and project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:25.378896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:06:25.381146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:06:25.438896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-245b92da-afaf-4488-87ac-ce4e43de757a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.883343 Aug 25 03:06:25.465943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 17/27] 10.222.0.75 () {62 vars in 1188 bytes} [Thu Aug 25 03:06:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 25 03:06:25.482763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b080d6e5-d8f8-4df6-94bf-1f10a3fd2d98 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff197f8d940>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:25.599771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7a468877-ad55-4da9-b04b-b3ad7dc247d6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.350382 Aug 25 03:06:25.600694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 11/28] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:06:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:06:25.682998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5f58a70e-8ba8-479c-9eb6-b1d2a38cca5e tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:25.684011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5f58a70e-8ba8-479c-9eb6-b1d2a38cca5e tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:25.820194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5f58a70e-8ba8-479c-9eb6-b1d2a38cca5e tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:25.834786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5f58a70e-8ba8-479c-9eb6-b1d2a38cca5e tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1214 microversion: 2.1 time: 0.182267 Aug 25 03:06:25.837942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 12/29] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:25 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:25.844303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:25.906700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:25.958838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b080d6e5-d8f8-4df6-94bf-1f10a3fd2d98 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.491182 Aug 25 03:06:25.968243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 18/30] 10.222.0.75 () {58 vars in 1134 bytes} [Thu Aug 25 03:06:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:25.974768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6eabdcac-b1db-469b-9958-65b460c40132 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:25.981603 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6eabdcac-b1db-469b-9958-65b460c40132 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:26.073845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:26.085823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:26.089203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:26.090463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7061ba45-e7ce-4377-886e-273aa34ad73c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1279 microversion: 2.20 time: 0.251306 Aug 25 03:06:26.104309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 13/31] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:25 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:26.123141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6eabdcac-b1db-469b-9958-65b460c40132 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:26.125514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-40696c3b-c5bc-4d16-9587-0536309dabf7 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff193f9cf70>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:26.153278 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6eabdcac-b1db-469b-9958-65b460c40132 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1222 microversion: 2.1 time: 0.182271 Aug 25 03:06:26.153899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 19/32] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:25 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1222 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:26.330399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-40696c3b-c5bc-4d16-9587-0536309dabf7 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.237705 Aug 25 03:06:26.341526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 14/33] 10.222.0.75 () {58 vars in 1167 bytes} [Thu Aug 25 03:06:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:26.360073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-42557bd5-d1b7-44cd-8b8d-a7c1100fcbe4 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff197f92670>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:26.481210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-42557bd5-d1b7-44cd-8b8d-a7c1100fcbe4 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.139008 Aug 25 03:06:26.490102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 20/34] 10.222.0.75 () {58 vars in 1170 bytes} [Thu Aug 25 03:06:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:26.501705 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-88ef6ea1-3242-4002-9070-9b15ee3f8b5c tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff193ffcd30>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:26.691084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-88ef6ea1-3242-4002-9070-9b15ee3f8b5c tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.198543 Aug 25 03:06:26.700911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 15/35] 10.222.0.75 () {58 vars in 1155 bytes} [Thu Aug 25 03:06:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:26.714908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-60c9dfb0-9ab2-474d-9400-1f7ae14f9cec tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff197fb1280>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:26.859134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:26.859966 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:26.872344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:26.874453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:26.875406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:26.878513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:26.879761 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:26.880880 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:27.050085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-60c9dfb0-9ab2-474d-9400-1f7ae14f9cec tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.348848 Aug 25 03:06:27.050668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 21/36] 10.222.0.75 () {58 vars in 1188 bytes} [Thu Aug 25 03:06:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:27.070684 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3f3645c1-1c47-44d1-a1ab-e4fff63e4ca3 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] Calling method '.version_select at 0x7ff197fab430>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:27.172064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:27.224635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-15f77c1b-be93-4de7-b8d7-f2b5b77be2ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1218 microversion: 2.1 time: 0.361302 Aug 25 03:06:27.225305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 16/37] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:26 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1218 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:27.237185 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:27.251453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:27.348410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3f3645c1-1c47-44d1-a1ab-e4fff63e4ca3 tempest-VolumesTestJSON-1347220599 tempest-VolumesTestJSON-1347220599-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.282940 Aug 25 03:06:27.360170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 22/38] 10.222.0.75 () {58 vars in 1155 bytes} [Thu Aug 25 03:06:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:27.360170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-52a6a153-d6d5-40fe-b56c-1e5214f79ebc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:27.360170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-52a6a153-d6d5-40fe-b56c-1e5214f79ebc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:27.434068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:27.445991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:27.451262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:27.454897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ea106d91-789e-4d01-8aae-ce1b86addf5a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1279 microversion: 2.20 time: 0.226089 Aug 25 03:06:27.455639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 17/39] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:27 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:27.496213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-52a6a153-d6d5-40fe-b56c-1e5214f79ebc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:27.510545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-52a6a153-d6d5-40fe-b56c-1e5214f79ebc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1222 microversion: 2.1 time: 0.157099 Aug 25 03:06:27.513689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 23/40] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:27 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1222 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:28.255347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:28.256187 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:28.263693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.264446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.265027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.265974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.266566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.267129 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.386797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:28.398596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6a3921c8-cb2a-4c74-bff9-9771691c1a3c tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1266 microversion: 2.1 time: 0.147410 Aug 25 03:06:28.399738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 18/41] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:28 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:28.482322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:28.482877 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:28.489154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.489642 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.490078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.490795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.491255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.491683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.547026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:28.548656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:28.573518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.577361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.579991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.581073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:28.585504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:28.587018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:28.752376 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:28.767822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-43d28530-ff8f-461b-a131-9504d521612f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1218 microversion: 2.1 time: 0.229316 Aug 25 03:06:28.803389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 19/42] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:28 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1218 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:28.854601 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:28.890523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:28.892075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:28.892990 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-70635611", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f35a7bb-9c1a-41d2-92fd-9043716fc14c"}], "security_groups": [{"name": "tempest-securitygroup--1050777318"}], "key_name": "tempest-keypair-1669693590", "user_data": "}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:28.893252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-709de8a6-d1e7-4a8c-8bdf-8e4ac907fd5f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1275 microversion: 2.20 time: 0.415101 Aug 25 03:06:28.893815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 24/43] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:28 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1275 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:29.128007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] validate_networks() for [('1f35a7bb-9c1a-41d2-92fd-9043716fc14c', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:06:29.422952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:29.425718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:29.451909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:29.452744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:29.453410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:29.458192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:29.458993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:29.462678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:29.600138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:29.611290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-63de1d01-5703-43da-866c-b3b3fcb2cc47 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1274 microversion: 2.1 time: 0.193567 Aug 25 03:06:29.613540 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 25/44] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:29 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:29.796762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:29.797527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:29.810348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:29.810921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:29.811443 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:29.812264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:29.812911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:29.813714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:30.533977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:30.571912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ffb0ed1d-a455-4069-9d62-b4b5abc1502f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1282 microversion: 2.1 time: 0.775135 Aug 25 03:06:30.584104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 26/45] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:29 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1282 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:30.591047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:30.592182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:30.605655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:30.607608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:30.608729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:30.609871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:30.610638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:30.611406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:30.843937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:30.861723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:30.865639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:30.876827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-853e95d7-74b0-466e-afcd-d046b8ee393c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1339 microversion: 2.20 time: 0.283219 Aug 25 03:06:30.886996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 27/46] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:30 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1339 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:30.901816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:30.905173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:30.960525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:30.968139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:30.972624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:30.979601 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:30.981373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:30.982357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.147419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:06:31.149483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:06:31.150203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:06:31.150776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:06:31.151401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:06:31.182076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:31.182293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.182707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.184963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.189832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.190327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.190914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.197179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0699882f-1b70-4c15-960a-57c9180fb9eb tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1272 microversion: 2.1 time: 0.300100 Aug 25 03:06:31.198060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 28/47] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:30 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:31.327672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:06:31.365919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for user 804df9333a474723968f97eb9d6bfc69 and project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:06:31.380716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:06:31.385654 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:06:31.594973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5bedbf78-18f2-47a9-8ef4-f69566bfb616 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.706640 Aug 25 03:06:31.603636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 20/48] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:06:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:06:31.608820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:31.609443 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:31.609979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-316fdf3f-3d37-481d-93a0-6711c87fd199 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:31.610877 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-316fdf3f-3d37-481d-93a0-6711c87fd199 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:31.621022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.621539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.631971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.631971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.631971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.631971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.947520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:31.947520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6ebf5b7a-f975-4e56-a16b-bdf87994b5b1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1280 microversion: 2.1 time: 0.258073 Aug 25 03:06:31.947520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 29/49] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:31 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1280 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:31.949362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-316fdf3f-3d37-481d-93a0-6711c87fd199 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:31.949362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-316fdf3f-3d37-481d-93a0-6711c87fd199 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1236 microversion: 2.1 time: 0.285431 Aug 25 03:06:31.949362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 21/50] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:31 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1236 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:31.949819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:31.949819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:31.949819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.949819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.951101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:31.951101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:31.951101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:31.951101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:32.095416 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:32.106786 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:32.109638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:32.110792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-731cd4fd-28ed-4b07-9c0b-b5c9b41f59a2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1337 microversion: 2.20 time: 0.211769 Aug 25 03:06:32.112824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 30/51] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:31 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:32.219913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:32.220626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:32.231838 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:32.233914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:32.234579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:32.235476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:32.236200 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:32.236906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:32.340032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:32.365652 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0c7df63f-2a82-4108-93e6-16a552ed3d73 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1272 microversion: 2.1 time: 0.149879 Aug 25 03:06:32.372805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 22/52] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:32 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:32.942840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-28dd2195-ab62-40ad-918f-23a3fcaf2e24 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:32.943484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-28dd2195-ab62-40ad-918f-23a3fcaf2e24 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:32.947884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:32.948631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:32.959888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.001288 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.001854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:33.017969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.018585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.024980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:33.538596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-28dd2195-ab62-40ad-918f-23a3fcaf2e24 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:33.551348 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-28dd2195-ab62-40ad-918f-23a3fcaf2e24 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1236 microversion: 2.1 time: 0.613792 Aug 25 03:06:33.558566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 23/53] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:32 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1236 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:33.584010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:33.584010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:33.590270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.591434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.592092 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:33.593303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.594172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.594873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:33.813680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:33.832167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5675e53d-3505-44e6-b9ee-e3ac8be82fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.895123 Aug 25 03:06:33.833053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 31/54] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:32 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:33.846937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:33.846937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:33.857860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.858534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.859043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:33.860036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:33.860857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:33.861449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:34.050079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:34.059809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:34.063243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:34.065071 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-97edf140-d03e-49ce-9c91-fed50282371b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1337 microversion: 2.20 time: 0.503059 Aug 25 03:06:34.084506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 24/55] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:33 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1337 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:34.575904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:34.576676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:34.585263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:34.585792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:34.586306 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:34.587028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:34.587603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:34.588033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:34.602626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:34.623518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e2ad430c-fa4c-4021-a33e-07db5e94d806 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.788827 Aug 25 03:06:34.632458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 32/56] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:33 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:34.819952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:34.834572 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2921889c-9a72-4579-a9c0-08df6509e478 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1232 microversion: 2.1 time: 0.261632 Aug 25 03:06:34.851841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 25/57] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:34 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1232 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:34.864092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:34.867355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:34.878316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:34.882291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:34.884270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:34.890155 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:34.891214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:34.891658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.022352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=4 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:35.098216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:35.099106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:35.113122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.118213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.119276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.121209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.124587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.128668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.585868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:35.595143 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d2d7b00e-102c-42a2-8456-90932ab11372 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.735899 Aug 25 03:06:35.595762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 33/58] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:34 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:35.636621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:35.653271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:35.662376 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:35.664864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:35.666225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-98658b9b-6530-4fb9-aa85-1652f9b733a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.580227 Aug 25 03:06:35.667042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:35.670020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 26/59] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:35 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:35.679002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.679810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.684417 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.685395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.686692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.687598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.862298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:35.873173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:35.890515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.891027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.891470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.892238 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:35.894768 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:35.895210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:35.985893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:35.991318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:36.006286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-eff4be86-ef33-4eb2-955f-5773fdd14ebe tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.350187 Aug 25 03:06:36.008889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 34/60] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:35 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:36.019403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-76f73d44-9209-49bd-b77d-3784c971f38f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1288 microversion: 2.1 time: 0.162383 Aug 25 03:06:36.021726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 27/61] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:35 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1288 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:36.626518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:36.627129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:36.639524 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.648558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.648558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.648558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.648558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.650163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.795795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbd488ac-822f-4fe0-9a52-b283ee2bea81", "tag": "bacac1ae-1613-4692-89fe-53fb069eb6ad"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:36.810820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.818109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.818109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.837590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Creating event network-changed:bacac1ae-1613-4692-89fe-53fb069eb6ad for instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 on hv-cinder-77957 Aug 25 03:06:36.838221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121255) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 03:06:36.838612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c130b424-a29f-404e-b88c-a9e42b53f646 req-00df9708-9260-4c52-b511-3fddc778c993 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121255) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 03:06:36.839766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.840259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.840687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.841540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.842111 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.842578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.852763 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.compute.rpcapi [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 03:06:36.853650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] Releasing lock "compute-rpcapi-router" {{(pid=121255) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 03:06:36.886158 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e9c71719-cbfd-4128-919a-5f1f282f8d74 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207785 Aug 25 03:06:36.888584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 28/62] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:36.919257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:36.919983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:36.934867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.937494 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.944139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:36.944139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:36.944139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:36.944139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.307156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:37.325357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9152241e-80bc-46e8-ab49-dc6b9b7bf106 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.702537 Aug 25 03:06:37.341519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 35/63] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:36 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:37.403508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:37.421023 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:37.422882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:37.424249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-57d03b61-6955-4b03-a95f-88dd2ff7ff1c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.521944 Aug 25 03:06:37.425305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 29/64] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:36 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:37.443379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:37.444004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:37.454316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.455273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.456019 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.457180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.458240 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.458962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.502508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=26 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:37.677638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed82b6fd-a60a-437b-880a-25b6424b88e1", "tag": "394d8269-455c-479a-bedf-bdf902220c4d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:37.683628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.684873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.685526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.729652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Creating event network-changed:394d8269-455c-479a-bedf-bdf902220c4d for instance ed82b6fd-a60a-437b-880a-25b6424b88e1 on hv-cinder-77957 Aug 25 03:06:37.732591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 25 03:06:37.732996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-d4fab499-f7ab-4ec0-a414-df11fbe78eca req-5b81e067-0926-4739-b9ce-3ff23918158b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 25 03:06:37.734775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.735578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.738335 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.739506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.740762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.743012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.753698 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.compute.rpcapi [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 25 03:06:37.757096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] Releasing lock "compute-rpcapi-router" {{(pid=121256) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 25 03:06:37.793705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1c9f05f7-faca-4ca9-8b38-f3b254f7f0ee None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450552 Aug 25 03:06:37.799273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 36/65] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:37.805503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:37.806411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:37.818286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.818794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.819228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:37.820045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:37.821354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:37.822061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.063195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.076078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b697d212-43b9-48f2-9d5d-76ec62f81e1f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.649330 Aug 25 03:06:38.079009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 30/66] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:37 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:38.118629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.133304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f243a6c6-ead1-4f32-8cc6-208400be3184 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1306 microversion: 2.1 time: 0.337229 Aug 25 03:06:38.139631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 37/67] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:37 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1306 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:38.354816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:38.355414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:38.372612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:38.373096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:38.373532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.374307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:38.374731 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:38.384832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.449560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:38.450665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:38.464801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:38.466469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:38.467133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:38.467703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.468681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:38.469276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:38.469836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.674611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.684671 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.686483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.687776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0f9c4aa5-664a-4b4b-b92f-ecc7d414cd42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.242491 Aug 25 03:06:38.688513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 38/68] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:38 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:38.774016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:38.791208 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1dd64f48-ccc5-4c4d-8f88-74c2d3a39d73 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.436819 Aug 25 03:06:38.792372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 31/69] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:38 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:38.926509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74280ff-4eca-4761-80a8-4a2dc9064abd", "tag": "ed1654d2-e4df-42ab-af33-04952194d07a"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:38.945915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:38.952411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:38.952411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:38.960813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] Creating event network-changed:ed1654d2-e4df-42ab-af33-04952194d07a for instance e74280ff-4eca-4761-80a8-4a2dc9064abd on hv-cinder-77957 Aug 25 03:06:38.967315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-c2e559ff-466b-4af8-8099-7361e5626cc4 req-caf48261-d9fb-41c0-a7d7-9e259f23bbeb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047712 Aug 25 03:06:38.972463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 39/70] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:39.106823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:39.107976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:39.116877 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:39.143636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.145051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.147802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.149079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.150596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.155742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.166779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:39.169334 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:39.198606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.203023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.204465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.209447 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.210327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.215071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.733509 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:39.745521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-34e4886c-d217-4b36-a408-bee2680db066 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.645293 Aug 25 03:06:39.762468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 32/71] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:39 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:39.764258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:39.770302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:39.774036 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:39.774387 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:39.778349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.779201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.780045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.781604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.782315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.782622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4a4ec3e6-0af0-4824-87ed-cfd1cd8a2eac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1294 microversion: 2.1 time: 0.618405 Aug 25 03:06:39.783348 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.786495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 40/72] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:39 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1294 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:39.824104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:39.824755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:39.845209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.847881 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.848449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:39.849190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:39.852731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:39.853367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:40.170414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:40.178073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9b7d16f4-1064-47b3-9bde-cc5d2efafe4c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.367396 Aug 25 03:06:40.178901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 41/73] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:39 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:40.184261 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:40.193857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:40.194556 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:40.195118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:40.215126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] Creating event network-changed:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:06:40.227402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-29dde927-ee24-4b05-aa04-4690bf1418a0 req-9c93d339-cd35-4bd4-aa57-9a3c5424bd56 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046995 Aug 25 03:06:40.228606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 42/74] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:40.642620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:40.656932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:40.658737 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:40.662238 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3d465171-6397-451e-8a39-64a589d7170b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.898317 Aug 25 03:06:40.671410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 33/75] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:39 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:40.787600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:40.788404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:40.807352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:40.808333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:40.808921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:40.815736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:40.815736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:40.815736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:40.824250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:40.825003 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:40.855035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:40.855035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:40.855035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:40.855035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:40.855310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:40.855310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:41.300651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.309087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e080a493-8f4a-4599-adb6-3ed1e1620e59 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.534376 Aug 25 03:06:41.323963 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 43/76] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:40 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:41.329586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:41.330362 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:41.345861 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:41.346587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:41.347267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:41.349276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:41.349910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:41.352459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:41.513795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.529903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6af44a44-e7eb-4154-9e7a-96b75051a4da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.725314 Aug 25 03:06:41.530935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 34/77] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:40 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:41.584412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.589394 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-32f6f7cb-c67f-4cbe-89f6-04de94e25562 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.264050 Aug 25 03:06:41.590068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 44/78] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:41 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:41.698814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:41.700421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:41.707075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:41.707671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:41.708234 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:41.709021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:41.709545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:41.710128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:41.922655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.926134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:41.938837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.940486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:41.947354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-02357f17-c85a-43e9-b08c-c7393722e1b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.247520 Aug 25 03:06:41.957237 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 35/79] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:41 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:42.332639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:42.333447 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:42.340078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.341238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.341878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.342958 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.343415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.343994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.540006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:42.548975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b46bdda5-2cd1-4749-8fc1-779a1cac8a55 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.222490 Aug 25 03:06:42.555470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:42.557020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:42.563857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.564411 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.569797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 45/80] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:42 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:42.569930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.569930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.569930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.569930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.610978 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:42.615634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:42.620188 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.620893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.621502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.622368 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.622969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.623769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.813826 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:42.823593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f7104f8f-4013-4502-b526-2b8435e2fe21 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.216022 Aug 25 03:06:42.837993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 46/81] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:42 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:42.839131 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:42.848385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4c131874-14e9-444d-9fd4-9927e4ef9829 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.297348 Aug 25 03:06:42.860252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 36/82] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:42 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:42.968174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:42.975939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:42.975939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.975939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.975939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:42.976493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:42.976936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:42.977380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.116571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:43.125797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:43.127475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:43.128744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fa116b5a-9944-4e9a-b96b-297804944acd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.164393 Aug 25 03:06:43.129764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 47/83] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:42 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:43.461498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832b5cf4-2011-4790-8c89-e4078b8cf262", "tag": "b1565188-c9dd-4f38-9acf-24035dbedd9f"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:43.472414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.472910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.473335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.486630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] Creating event network-changed:b1565188-c9dd-4f38-9acf-24035dbedd9f for instance 832b5cf4-2011-4790-8c89-e4078b8cf262 on hv-cinder-77957 Aug 25 03:06:43.492417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-15fd14de-33ac-41b1-a89c-eaeb8521bb39 req-620194c2-7c55-4868-b413-3575cc719c29 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Aug 25 03:06:43.494371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 37/84] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:06:43.582284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:43.583552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:43.590834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.591661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.592088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.593026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.593469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.594101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.742292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:43.751623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4a5d1ae1-450a-49d2-9ac2-1821e47b69b3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.172991 Aug 25 03:06:43.752846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 48/85] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:43 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:43.843499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=30 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:43.848016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:43.865269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:43.865269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.865269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.865269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.866428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.866428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.866428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.887854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:43.892923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:43.901848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.902440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.902887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:43.903584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:43.904037 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:43.904546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:44.005058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.013889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a47f91a3-56bc-422e-9a57-eb50fb2f8b5e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.171258 Aug 25 03:06:44.014450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 38/86] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:43 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:44.049031 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.057939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-97606fab-c1a2-409d-8d43-3fa338365932 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.184556 Aug 25 03:06:44.064193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 49/87] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:43 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:44.151653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:44.152287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:44.158553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:44.159032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:44.159461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:44.160183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:44.160633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:44.161052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:44.300360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.309182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.311337 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.312554 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-75cad5a7-edfc-44ae-a308-2483774b54c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.165208 Aug 25 03:06:44.313107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 39/88] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:44 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:44.775442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:44.776044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:44.783114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:44.783600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:44.784199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:44.784819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:44.785274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:44.786017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:44.926254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:44.935436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0f6d09bf-7c01-43ac-b717-809527ccaf76 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.164426 Aug 25 03:06:44.936013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 50/89] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:44 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:45.038263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:45.038263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:45.043923 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.044917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.044917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.045530 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.045980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.046394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.083193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:45.087788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:45.102264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.102921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.106233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.108054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.113848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.114323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.241064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:45.261201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b682f70f-c5ee-4d12-818f-0ff0177c5f33 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.230684 Aug 25 03:06:45.261792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 40/90] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:45 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:45.285329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:45.294840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-090591a2-4487-4871-8f16-7a12455cd241 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.218167 Aug 25 03:06:45.295253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 51/91] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:45 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:45.335225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:45.336026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:45.343184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.343779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.344389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.345282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.345933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.346431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.488398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:45.497349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:45.498841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:45.499928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-aa1ebb47-e453-4aa2-8665-73965e311242 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.169099 Aug 25 03:06:45.500675 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 41/92] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:45 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:45.957122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:45.957776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:45.964977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.965683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.966117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:45.966815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:45.967270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:45.967768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.146206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.154404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-89dfd78a-6882-4fba-b0f8-a88f39fc7adc tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.201196 Aug 25 03:06:46.155578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 52/93] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:45 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:46.282870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:46.283468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:46.290875 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.305261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.305261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.305261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.305261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.306069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.314995 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:46.315547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:46.322285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.322771 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.323511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.324237 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.324929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.325364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.432698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.441366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8ad6b53e-bd19-4d6d-afbd-4c529be5312b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.162233 Aug 25 03:06:46.442155 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 42/94] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:46 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:46.471024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.473469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b7fd15b7-3f79-461f-a773-52d7795e78eb tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.162611 Aug 25 03:06:46.474040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 53/95] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:46 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:46.528951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:46.528951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:46.533921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.534473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.534982 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.535753 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:46.536309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:46.536741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:46.717521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.726214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.727808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:46.730029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cc1ac5ea-8363-4a70-8ceb-00a340542e3b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.211909 Aug 25 03:06:46.730702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 43/96] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:46 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:47.175018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:47.181407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:47.182239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.182722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.183149 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.183827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.184400 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.184929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.319407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.327606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fc8422c5-5a24-4287-b3b0-34e762c835d7 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.156511 Aug 25 03:06:47.328255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 54/97] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:47 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:47.463286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:47.463816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:47.465659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=8 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:47.470702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.470803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.471242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.471920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.472399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.472860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.494574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:47.495218 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:47.501149 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.505185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.505185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.505185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.505185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.505570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.605479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.613350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6903ae3d-2b4d-4b42-9e9e-946a87ea94d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.154766 Aug 25 03:06:47.617104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 44/98] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:47 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:47.635809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.643953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-41a1fe8d-d4bd-435a-a4da-53ace7901679 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.153186 Aug 25 03:06:47.644593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 55/99] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:47 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:47.753408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:47.754013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:47.761455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.761938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.762376 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.763064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:47.763513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:47.763931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:47.902623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.911526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.913093 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:47.920314 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1cdc0c17-0741-4e2b-a017-2b869e61b9d4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.164636 Aug 25 03:06:47.921431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 45/100] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:47 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:48.348931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:48.350046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:48.352454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:48.357534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.358016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.358612 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.359305 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.359906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.360355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.494800 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:48.503526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-76ea0244-9eb3-4590-879a-86645e7604ba tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.158427 Aug 25 03:06:48.504102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 56/101] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:48 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:48.635709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:48.636455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:48.642485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.642946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.643377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.644063 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.644540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.644960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.665173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:48.666052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:48.672421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.673098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.673709 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.678862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.678862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.678862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.789162 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:48.799583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-81eff294-a537-437d-b524-4d3d1ec2a34a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.166852 Aug 25 03:06:48.799583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 46/102] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:48 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:48.816628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:48.825620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b96c3e07-8942-4a04-80a1-51c584381436 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.163964 Aug 25 03:06:48.829397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 57/103] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:48 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:48.949019 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:48.949710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:48.956027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.956608 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.957106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:48.963012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:48.963012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:48.963012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.101468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:49.110320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:49.111829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:49.113012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-51d53a92-2fd5-49fc-8872-221e758a20ba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.172490 Aug 25 03:06:49.113743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 47/104] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:48 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:49.526713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:49.527327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:49.537370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.537858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.538685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.549372 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.549899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.550337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.600527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:49.752409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:49.762262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5b242564-ecf1-47f9-b0ae-e7ab33e2a791 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.240634 Aug 25 03:06:49.762849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 58/105] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:49 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:49.819000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:49.820232 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:49.840126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.846343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.848715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.850124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:49.853648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.854164 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.854530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:49.854677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.863143 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.864256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.876161 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:49.877274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:49.879030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:49.879707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:50.119747 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:50.132869 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-62ad4455-0283-47a9-8883-9a3bb09a577e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.317512 Aug 25 03:06:50.135494 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 48/106] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:49 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:50.143481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:50.148962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:50.165828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:50.170477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:50.170477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:50.170477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:50.170477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:50.170896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:50.199309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:50.210663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4651340a-1d2a-43e1-92d1-93d266ff3085 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.368201 Aug 25 03:06:50.212077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 59/107] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:49 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:50.328827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:50.337695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:50.339337 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:50.340693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-05e8ec0f-521c-466c-a715-2099ba1ccebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.201286 Aug 25 03:06:50.341244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 49/108] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:50 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:50.783126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:50.783731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:50.789697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:50.790173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:50.790609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:50.791289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:50.791734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:50.792183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.154360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.158962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:51.159577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:51.165330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9d5cf73a-4d4f-4a7f-b11b-2026ba4b4799 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.385637 Aug 25 03:06:51.165868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 60/109] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:50 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:51.166071 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.166640 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.167157 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.167861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.168356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.168786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.232572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:51.233177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:51.239312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.239802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.240257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.241255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.241717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.242140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.364694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.373678 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e260243f-6d6f-4d70-9848-01ac610413cc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.218555 Aug 25 03:06:51.374259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 50/110] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:51 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:51.379352 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:51.379950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:51.386272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.386954 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.387679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.388878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:51.389610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:51.390191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:51.425732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.435097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fbe98585-262a-418c-8297-82d913f6226b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.207579 Aug 25 03:06:51.445515 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 61/111] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:51 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:51.548724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.557340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.558838 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:51.565874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-556cb0e9-641e-4fcd-b4b9-676a434ce78a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.184767 Aug 25 03:06:51.565874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 51/112] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:51 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:52.186879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:52.187646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:52.193765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.194251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.194682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.195367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.195813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.199478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.346345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.354860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-be1e4efc-deb0-472d-a4e3-d4ae75a98c97 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.172237 Aug 25 03:06:52.355422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 62/113] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:52 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:52.397026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:52.397622 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:52.403638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.404129 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.404570 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.405249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.405693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.406110 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.458757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:52.470500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:52.470500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.470500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.470500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.470883 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.471488 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.472285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.541975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.549470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8be49f70-bceb-4558-a20a-fae50e07724b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.156216 Aug 25 03:06:52.550033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 52/114] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:52 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:52.582805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:52.583396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:52.589842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.590322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.590746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.591425 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:52.591869 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:52.592365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:52.597287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:52.611695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.619908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-287e3483-e1bf-4236-89a8-95fec3c8678a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.166953 Aug 25 03:06:52.620734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 63/115] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:52 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:52.721221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.729759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.731266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:52.743412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3078c314-1501-4b44-85f6-6388437ea7bc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.153548 Aug 25 03:06:52.743412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 53/116] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:52 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:06:53.375981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:53.376615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:53.382853 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.383345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.383902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.384600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.385045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.390628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.524617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:53.529305 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-265e7398-c521-4c2f-baba-16ca7f8f2a15 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.157091 Aug 25 03:06:53.529886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 64/117] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:53 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:53.570307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:53.571185 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:53.578325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.578897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.579591 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.580412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.580994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.581495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.640750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:53.641720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:53.648759 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.649869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.650307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.651018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.651499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.651922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.882154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:53.897013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c895afed-9ec3-4604-8cf8-c48a139a6954 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.257870 Aug 25 03:06:53.897013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 65/118] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:53 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:53.909399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:53.910000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:53.923421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.925986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.926642 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:53.927593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:53.931602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:53.932401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:54.156104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:54.164091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cfa05888-a98e-4d1e-bb8d-53c1272f5412 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.598009 Aug 25 03:06:54.172268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 54/119] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:53 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:54.222308 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:54.235967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:54.239828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:54.241033 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e9710903-2307-4c12-a5ee-01478f1bc5c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.344376 Aug 25 03:06:54.244915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 66/120] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:53 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:54.411916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed82b6fd-a60a-437b-880a-25b6424b88e1", "name": "network-vif-plugged", "status": "completed", "tag": "394d8269-455c-479a-bedf-bdf902220c4d"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:54.423418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:54.424350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:54.425148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:54.438671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] Creating event network-vif-plugged:394d8269-455c-479a-bedf-bdf902220c4d for instance ed82b6fd-a60a-437b-880a-25b6424b88e1 on hv-cinder-77957 Aug 25 03:06:54.447202 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-0268c225-bcd2-4942-b5da-1d254ec090d0 req-a29d12d5-7c2d-4e87-b8dc-a030182294e8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131669 Aug 25 03:06:54.448007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 55/121] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:54.553561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:54.554786 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:54.577046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:54.577046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:54.577046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:54.577046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:54.577322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:54.577322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:54.801040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:54.816067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4d24c158-0335-4159-81bf-b63ae7be7174 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.268703 Aug 25 03:06:54.816725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 67/122] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:54 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:54.918206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:54.919113 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:54.925945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:54.926679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:54.927333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:54.928840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:54.930027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:54.931235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.192969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:55.195083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:55.210901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.212387 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.213157 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.214506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.215650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.216560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.282582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.295800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d7b4cf74-12cf-4566-86f0-07f8a5e637b9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.382638 Aug 25 03:06:55.311116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 56/123] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:54 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:55.318004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:55.318767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:55.326537 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.327329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.328024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.329154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.329748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.330327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.388430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.396080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-89e5b710-eb63-416b-a5bd-aec06c1b4771 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.208335 Aug 25 03:06:55.396676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 68/124] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:55 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:55.573252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.594059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.599967 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.604725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-14dbc52c-377e-4128-ac24-d73449af9da8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.291869 Aug 25 03:06:55.606372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 57/125] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:55 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:55.837666 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:55.838919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:55.845404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.845980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.846502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.847465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:55.848025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:55.848606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:55.986924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:55.994888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-214003c0-deb4-480c-ae19-6443dbe3ae11 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.161671 Aug 25 03:06:55.995461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 69/126] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:55 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:56.318262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:56.318947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:56.325344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.325820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.326434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.327321 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.327809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.328270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.418286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:56.418845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:56.424832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.425317 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.425750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.426516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.426909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.427336 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.507180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:56.520980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-de64d56b-7376-4548-9ee5-dde9fb7ceb8d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.206719 Aug 25 03:06:56.521942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 58/127] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:56 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:56.528386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd488ac-822f-4fe0-9a52-b283ee2bea81", "name": "network-vif-plugged", "status": "completed", "tag": "bacac1ae-1613-4692-89fe-53fb069eb6ad"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:56.572566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.572566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.572566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.572566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] Creating event network-vif-plugged:bacac1ae-1613-4692-89fe-53fb069eb6ad for instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 on hv-cinder-77957 Aug 25 03:06:56.577368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-63f68903-5f88-4110-9037-a425be489e71 req-ae9aefb0-c5a2-4f84-b3c8-9682401fc5af service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053899 Aug 25 03:06:56.578291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 59/128] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:56.583952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:56.591970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-242d771b-fe6c-4cf8-bd0b-0c274926cd5f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.177905 Aug 25 03:06:56.592587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 70/129] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:56 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:56.629279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:56.630000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:56.637908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.638480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.638933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.639623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:56.640082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:56.640564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:56.824650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:56.833646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:56.835333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:56.846820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3b59d877-2a59-483a-a520-26b4120865c2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.211536 Aug 25 03:06:56.856649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 60/130] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:56 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:06:57.015618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:57.016274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:57.025491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.026498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.029310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.029310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.029310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.029310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.513391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:57.521923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-32f5c740-0a07-4bde-8cba-a6ce877799e3 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.509932 Aug 25 03:06:57.522768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 71/131] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:57 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:57.543334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:57.543942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:57.550085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.550642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.551079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.554349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.554349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.554349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.612944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:57.613614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:57.620425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.620905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.621337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.622022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.622466 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.622909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.690127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:57.700609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2233ea73-17aa-400c-9263-a9d197617831 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.161525 Aug 25 03:06:57.701177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 61/132] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:57 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:57.760650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:57.768285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d7bb5c30-ca2f-478a-ab21-f766ae47fcec tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.159188 Aug 25 03:06:57.768844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 72/133] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:57 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:57.893548 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:57.894147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:57.902132 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.902624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.903060 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:57.903925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:57.904636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:57.905085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.066704 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:58.076805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:58.078794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:58.079905 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1e829a38-3258-4862-ba06-bbcaac6758f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.190326 Aug 25 03:06:58.080498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 62/134] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:57 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:58.544360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:58.545069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:58.550872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.551725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.552413 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.553106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.553552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.553970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.646104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74280ff-4eca-4761-80a8-4a2dc9064abd", "name": "network-vif-plugged", "status": "completed", "tag": "ed1654d2-e4df-42ab-af33-04952194d07a"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:06:58.659109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.659891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.660645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.676329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] Creating event network-vif-plugged:ed1654d2-e4df-42ab-af33-04952194d07a for instance e74280ff-4eca-4761-80a8-4a2dc9064abd on hv-cinder-77957 Aug 25 03:06:58.682974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-98e29af5-72c7-4922-ab42-d6476456738d req-2112b394-3e2b-4f38-a4fb-5a295467db5d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040736 Aug 25 03:06:58.688058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 63/135] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:06:58.724100 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:58.724830 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:58.732024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.732778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.735607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.735607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.736009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.736481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.865738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:58.875088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a1313e0e-770f-430c-be35-8f77ea1fb0fa tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1314 microversion: 2.1 time: 0.335577 Aug 25 03:06:58.888899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 73/136] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:58 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:58.905167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:58.906162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:58.912754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.914162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.915440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:58.916454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:58.916996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:58.917576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:59.121696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:59.125254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:59.130996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f590a127-1233-4955-aea7-96f6fb191cb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.240796 Aug 25 03:06:59.131604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 74/137] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:58 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:06:59.137718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:59.138482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:59.144843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:59.147156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:59.147754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:59.149706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:59.149706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:59.150124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:59.170769 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:59.182611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f1cb3408-f854-43f8-a592-5070ae26f4af tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.462214 Aug 25 03:06:59.185436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 64/138] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:58 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:06:59.290987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:59.300179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:59.304291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:06:59.305835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ea96c643-5b1c-40eb-80f8-694c8356a922 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.172574 Aug 25 03:06:59.306398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 75/139] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:06:59 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:06:59.910816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:06:59.911444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:06:59.924549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:59.935061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:59.935061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:06:59.935061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:06:59.935061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:06:59.935549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.080309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.089672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5cb5f2aa-628e-4763-8733-6b00ca5e199a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1501 microversion: 2.1 time: 0.182691 Aug 25 03:07:00.090247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 65/140] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:06:59 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:00.155449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:00.156109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:00.162586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.163074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.163503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.164213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.165211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.165895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.207586 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:00.209748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:00.220336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.221076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.221670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.224382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.224382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.224382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.436538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.448330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-eae6dab4-f012-44b0-beb3-e7219ac744f0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.296667 Aug 25 03:07:00.449310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 76/141] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:00 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:00.455724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:00.456825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:00.495253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.495253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.495253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.495253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.495578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.495578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.495751 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.496586 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c4e8dbb3-4d28-4c20-8002-3614a862a1e0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.289861 Aug 25 03:07:00.501421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 66/142] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:00 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:00.620788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.628876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.630364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:00.631451 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d851ff66-ae63-4c79-b50f-9056c464351e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.180945 Aug 25 03:07:00.632012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 77/143] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:07:00 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:07:00.700868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "name": "network-vif-plugged", "status": "completed", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:00.725587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:00.726075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:00.726693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:00.739747 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] Creating event network-vif-plugged:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:07:00.745837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-90e73355-514c-47bd-83b7-d62cc90e2c40 req-ee178935-f16b-42a3-bb4d-386cedf993a0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048828 Aug 25 03:07:00.746440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 67/144] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:07:01.473360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:01.474624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:01.481540 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.482224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.482788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.484414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.485048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.485721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.519441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:01.520809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:01.527644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.528372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.528988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.529672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.530115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.530531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.667288 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:01.675557 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-117ea19f-14e8-4a3c-b530-ccfdb6894722 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1322 microversion: 2.1 time: 0.205967 Aug 25 03:07:01.676486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 78/145] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:01 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:01.682942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:01.683943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:01.693501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.694212 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.699307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.699307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:01.699307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:01.699307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:01.710614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:01.719976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-52500f54-74a2-4bc9-8f19-ca3f5fd57131 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.205053 Aug 25 03:07:01.720798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 68/146] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:01 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:01.856652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:01.866416 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:01.869115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:01.870136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e1aef204-117a-43da-9927-27b065a9759e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.192386 Aug 25 03:07:01.871018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 79/147] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:07:01 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:07:02.419459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d621aa38-68d7-4c22-92f0-9fda2b9715ce"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:02.419459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:02.422010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.422552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.423192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:02.424069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.424617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.425034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:02.697167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:02.697713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:02.703597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.704115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.704579 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:02.705262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.705710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.710813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:02.853451 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:02.870173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4eb7668a-e3c7-43de-a2ad-d36798085107 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1515 microversion: 2.1 time: 0.176849 Aug 25 03:07:02.870759 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 80/148] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:02 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:02.875483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:02.876068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:02.882068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.882796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.883256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:02.883965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:02.884623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:02.890714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.044289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:03.051984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1e8dcee7-5a64-4176-ba97-22b73ab04dc5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.179943 Aug 25 03:07:03.052598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 81/149] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:02 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:03.057301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832b5cf4-2011-4790-8c89-e4078b8cf262", "name": "network-vif-plugged", "status": "completed", "tag": "b1565188-c9dd-4f38-9acf-24035dbedd9f"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:03.067739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.068283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.068708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.082064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] Creating event network-vif-plugged:b1565188-c9dd-4f38-9acf-24035dbedd9f for instance 832b5cf4-2011-4790-8c89-e4078b8cf262 on hv-cinder-77957 Aug 25 03:07:03.088073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-9b8b62e7-479c-4178-b7ce-3466a46af2d0 req-8a873f00-50ec-42c1-8d6d-e49388166aea service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034145 Aug 25 03:07:03.088709 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 82/150] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:03.093811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:03.094461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:03.100645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.101123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.102319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.103194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.103858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.104338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.273854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:03.282279 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:03.284087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:03.285238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-78419157-619f-42f8-a037-3152b09cf84a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1405 microversion: 2.20 time: 0.195420 Aug 25 03:07:03.285781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 83/151] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:07:03 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:07:03.291811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:03.293304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:03.299424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.300380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.300810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.301503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.301947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.302363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.376798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'flavor' on Instance uuid e74280ff-4eca-4761-80a8-4a2dc9064abd {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:07:03.905323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9d250d18-1106-44bf-be9e-25efc36b03fd tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd/action" status: 200 len: 32 microversion: 2.1 time: 0.617315 Aug 25 03:07:03.909166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-68184bb3-4578-4b81-910f-034d29a62101 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "POST /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.495857 Aug 25 03:07:03.909166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 69/152] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:07:02 2022] POST /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1/os-volume_attachments => generated 194 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:03.910042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 84/153] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:07:03 2022] POST /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd/action => generated 32 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:07:03.924784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:03.925825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:03.937583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.937583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.937583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:03.937583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:03.937979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:03.937979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.081103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:04.082537 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:04.092490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.096732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.096732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.096732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.096732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.097094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.134649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:04.143680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7cd96277-469f-480f-a425-0e10f670d042 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.225139 Aug 25 03:07:04.144576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 70/154] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:03 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:04.250562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:04.259093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-63162216-0beb-4ced-9887-c1dfb2e4a3aa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.189313 Aug 25 03:07:04.259733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 85/155] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:04 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:04.314485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:04.315122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:04.321510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.322330 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.322684 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.323402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.323849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.324294 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.329186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:04.487223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:04.498644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:04.500158 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:04.501322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c1dd223d-d955-4a96-9c03-76d39dadf856 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1598 microversion: 2.20 time: 0.190875 Aug 25 03:07:04.501871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 71/156] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:07:04 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:07:04.524969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:04.525458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:04.531723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.532247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.532684 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.533374 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:04.533830 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:04.534252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:04.646174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d9b92646-55ca-4654-b0a9-6240444b5f6f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125336 Aug 25 03:07:04.646764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 86/157] 10.222.0.75 () {60 vars in 1316 bytes} [Thu Aug 25 03:07:04 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:07:05.168116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:05.169091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:05.178727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:05.179578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:05.180351 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:05.180965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:05.181551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:05.181926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:05.281131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:05.282068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:05.292937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:05.293195 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:05.293630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:05.294587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:05.295040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:05.295484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:05.385099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:05.396506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-91ced648-9424-41a6-95b5-734c35900a1c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.233455 Aug 25 03:07:05.397274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 72/158] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:05 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:05.706830 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:05.715404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-27f76492-7807-40b3-aab6-a1376d14d37a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.439783 Aug 25 03:07:05.715973 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 87/159] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:05 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:06.279160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:06.294511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:06.295432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:06.296061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:06.309704 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] Creating event network-changed:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:07:06.315105 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-c38506cc-1451-4cc9-9f91-76f750a0160b req-3f4ecd2c-efb6-4cb6-8425-b7ef011651fb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Aug 25 03:07:06.315777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 73/160] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:06.419946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:06.421346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:06.424608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:06.428056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:06.428644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:06.429146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:06.429998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:06.430569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:06.431056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:06.613041 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:06.621637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-974475ad-3e1b-407a-9b70-be9e21fd4ac6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.206346 Aug 25 03:07:06.622207 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 88/161] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:06 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:06.738034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:06.739264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:06.747681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:06.748688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:06.749416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:06.750341 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:06.751208 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:06.752224 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:06.929597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:06.938513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cecc200d-ca7c-4e59-b573-06800f8da7d2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.205420 Aug 25 03:07:06.939087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 74/162] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:06 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:07.643652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:07.645091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:07.652454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:07.653185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:07.653597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:07.654364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:07.655138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:07.655631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:07.823145 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:07.833304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5549bfa7-1000-407e-9ae8-e448d704aa17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.194019 Aug 25 03:07:07.834305 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 89/163] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:07 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:07.959004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:07.959726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:07.967130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:07.967689 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:07.968277 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:07.968965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:07.969413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:07.973489 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:08.128941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:08.138002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-db6c2ac2-b685-4a63-9d45-06cea6766097 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.182824 Aug 25 03:07:08.138601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 75/164] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:07 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:08.855045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:08.855619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:08.861849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:08.862327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:08.862799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:08.863492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:08.863938 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:08.864412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:08.882985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:09.008766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:09.016264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c5c79aa9-0d15-4a9a-97fb-704585d8c417 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.165713 Aug 25 03:07:09.016831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 90/165] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:08 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:09.159222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:09.160372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:09.167971 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:09.168583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:09.169009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:09.169691 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:09.170138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:09.170564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:09.361366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:09.369861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0f555ae7-dbdb-48b8-a2ef-4d75cbe26cca tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1362 microversion: 2.1 time: 0.214643 Aug 25 03:07:09.370748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 76/166] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:09 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:10.038402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:10.039062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:10.045818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.046304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.046741 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.047475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.047927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.048388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.183319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:10.193611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0a7c2302-3405-4296-be78-b678ecd574d7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.159454 Aug 25 03:07:10.194206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 91/167] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:10 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:10.390857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:10.391440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:10.398990 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.399243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.399663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.400479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.400993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.401429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.538453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:10.547485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-32fb391a-3513-421e-b3f9-e43f80d4d74b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1547 microversion: 2.1 time: 0.160425 Aug 25 03:07:10.548069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 77/168] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:10 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:10.569100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:10.569595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:10.577010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.577500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.577932 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.578628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:10.579078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:10.579503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:10.658027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7cdb5c9f-ff36-4d94-a854-0243e066592b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093047 Aug 25 03:07:10.658620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 92/169] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:07:10 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:11.218956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:11.219832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:11.234987 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:11.236272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:11.237380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:11.240104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:11.240851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:11.242423 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:11.470271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:11.479053 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5b392dde-ee52-4c86-b894-86a29cf2d61e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.267010 Aug 25 03:07:11.482052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 78/170] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:11 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:11.932058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "832b5cf4-2011-4790-8c89-e4078b8cf262", "tag": "b1565188-c9dd-4f38-9acf-24035dbedd9f"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:11.944912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:11.945657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:11.946328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:11.958918 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] Creating event network-changed:b1565188-c9dd-4f38-9acf-24035dbedd9f for instance 832b5cf4-2011-4790-8c89-e4078b8cf262 on hv-cinder-77957 Aug 25 03:07:11.964949 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-95dedb58-576b-42e6-bfd6-b0fa38dec06a req-77f0bd01-759f-4e98-9269-1f3d8c8da9b8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Aug 25 03:07:11.965541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 93/171] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:12.904257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:12.904257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:12.904257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:12.904257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:12.907074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:12.907074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:12.907074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:12.907074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:12.908342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:12.908342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6defd1ae-6551-4e85-967f-7fc5e68a2926 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.259297 Aug 25 03:07:12.908342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 79/172] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:12 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:13.300126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:13.301080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:13.314903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.315649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.316331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.317160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.317698 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.318213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.343548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:07:13.762629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c09c2d95-36f7-493c-85fc-ac70a751d71a tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 204 len: 0 microversion: 2.1 time: 0.466899 Aug 25 03:07:13.763177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 94/173] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:07:13 2022] DELETE /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:07:13.773145 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:13.773145 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:13.779419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.779914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.780381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.781076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.781525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.781943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.921314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:13.922006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:13.922559 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:13.930764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.931263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.931681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.932399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:13.932933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:13.933530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:13.939443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5cefd5fe-4a94-48e5-b2dd-a11ed100490d tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1553 microversion: 2.1 time: 0.170958 Aug 25 03:07:13.939443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 80/174] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:13 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:14.074646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:14.082503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-717aeae1-b66c-4af1-8e26-5f2ca680f426 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.166548 Aug 25 03:07:14.083092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 95/175] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:13 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:14.959951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:14.961082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:14.967414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:14.969860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:14.969860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:14.969860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:14.969860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:14.970207 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:15.103406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:15.106048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:15.106654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:15.112940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:15.113835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:15.113963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-092e9b04-6f5b-4f97-85aa-b515e17f44e9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1553 microversion: 2.1 time: 0.157462 Aug 25 03:07:15.114493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 81/176] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:14 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:15.120377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:15.123460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:15.123912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:15.124478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:15.467327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:15.475985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2c847e0b-163c-4a47-aa50-068d7a71786d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.374192 Aug 25 03:07:15.476987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 96/177] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:15 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:16.136192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:16.136797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:16.139169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=99 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:16.145434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:16.145932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:16.146345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:16.147032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:16.147480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:16.148510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:16.295546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:16.305122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fbe93af8-be23-40bf-8814-f84c8eaa1215 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1553 microversion: 2.1 time: 0.173407 Aug 25 03:07:16.321746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 82/178] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:16 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:16.500431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:16.501633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:16.511241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:16.511966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:16.512615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:16.513496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:16.514094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:16.514825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:16.675533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:16.683511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-af8e71f9-e8cb-4948-b392-cedce965c9a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.188145 Aug 25 03:07:16.684105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 97/179] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:16 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:17.330718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:17.331943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:17.345281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:17.345766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:17.346204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:17.347261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:17.347901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:17.349572 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:17.428274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed82b6fd-a60a-437b-880a-25b6424b88e1", "name": "network-vif-deleted", "tag": "394d8269-455c-479a-bedf-bdf902220c4d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:17.444833 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:17.445551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:17.446156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:17.458831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] Creating event network-vif-deleted:394d8269-455c-479a-bedf-bdf902220c4d for instance ed82b6fd-a60a-437b-880a-25b6424b88e1 on hv-cinder-77957 Aug 25 03:07:17.465087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-752655cb-0cea-4737-8442-11c8d92b418a req-f6fed1e3-531b-490c-be05-9aa0ae8bcee5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040540 Aug 25 03:07:17.465931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 98/180] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:17.486545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:17.495790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b365919f-77e2-48c7-a4d9-f207b765f69b tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1511 microversion: 2.1 time: 0.169457 Aug 25 03:07:17.496401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 83/181] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:17 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:17.705627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:17.706309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:17.713136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:17.713611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:17.714038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:17.714716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:17.715255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:17.715554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:17.848811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:17.857847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-545dd848-a9fd-46ce-aa7e-ad16fe336653 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.156295 Aug 25 03:07:17.858427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 99/182] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:17 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:18.516900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:18.517508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:18.526389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:18.527459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:18.528031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:18.528859 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:18.529574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:18.530071 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:18.569487 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:18.569487 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:18.569487 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:18.569487 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lazy-loading 'fault' on Instance uuid ed82b6fd-a60a-437b-880a-25b6424b88e1 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:07:18.622821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4529d06c4eda48f788ce7c0327366377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb0f7283fb84ea48fd468f22c721b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:18.631223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4437d20f-f349-44cb-88cc-f156329d7b49 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 200 len: 1350 microversion: 2.1 time: 0.118048 Aug 25 03:07:18.632981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 84/183] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:18 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:18.878821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:18.880022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:18.886426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:18.886913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:18.887339 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:18.888258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:18.888705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:18.889122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:19.030865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:19.040941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e9c1872c-b0a3-41fc-87a3-8ac062663e92 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.165819 Aug 25 03:07:19.041640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 100/184] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:18 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:19.653394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:19.653992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:19.662492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:19.662994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:19.663459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:19.664460 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:19.665049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:19.665149 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:19.683433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] HTTP exception thrown: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Request method failure captured: Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 HTTP/1.1 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBucrC3uegdmOWsnzXbQumnXha4tTrR6jrm9EIao6cTZ3KokskScKbJtHzNQp6hrDD6BjOt2V9NJk8eEOk-pdElRtMhRqPGUGcO4z4tb9xcuceJ7D76G_9vYyxK7kwy9SXd_KLkFzZ_dIrpLSQXmzXUQIztmWGPkUQ1qSazeYWC_cXV8 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:07:19.691417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eeb0f7283fb84ea48fd468f22c721b8b"}]}] Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 4529d06c4eda48f788ce7c0327366377 Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.693418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'ed82b6fd-a60a-437b-880a-25b6424b88e1'} Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:07:19.694223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.695893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.697039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Returning 404 to user: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:07:19.697039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d56926c4-0dda-4174-bf89-ea31974f36f9 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 404 len: 111 microversion: 2.1 time: 0.043395 Aug 25 03:07:19.697039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 85/185] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:19 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:07:19.807843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:19.810002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:19.817343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:19.817879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:19.818314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:19.819003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:19.819450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:19.820439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:19.835354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] HTTP exception thrown: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Request method failure captured: Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1/os-volume_attachments HTTP/1.1 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBucrC3uegdmOWsnzXbQumnXha4tTrR6jrm9EIao6cTZ3KokskScKbJtHzNQp6hrDD6BjOt2V9NJk8eEOk-pdElRtMhRqPGUGcO4z4tb9xcuceJ7D76G_9vYyxK7kwy9SXd_KLkFzZ_dIrpLSQXmzXUQIztmWGPkUQ1qSazeYWC_cXV8 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:07:19.840290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eeb0f7283fb84ea48fd468f22c721b8b"}]}] Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 4529d06c4eda48f788ce7c0327366377 Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.841415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'server_id': 'ed82b6fd-a60a-437b-880a-25b6424b88e1'} Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:07:19.842086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:19.851295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:19.853094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Returning 404 to user: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:07:19.853094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6abbcfe5-8ed4-4875-8647-065c3a56f10f tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038079 Aug 25 03:07:19.853094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 101/186] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:07:19 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:07:20.064584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:20.064584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:20.071311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:20.072755 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:20.073853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:20.079924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:20.079924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:20.079924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:20.222793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:20.231900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1aba379d-fcdb-4e29-8184-fcdced378c81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.172774 Aug 25 03:07:20.232774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 86/187] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:20 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:21.262102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:21.262900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:21.269028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:21.269510 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:21.269943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:21.273880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:21.273880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:21.273880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:21.410420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:21.419619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bc41e6f2-bd15-46ed-ad5e-8ef469d5cec7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.162908 Aug 25 03:07:21.420212 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 102/188] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:21 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:22.439925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:22.440572 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:22.447774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:22.448292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:22.448727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:22.449436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:22.449895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:22.450320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:22.582416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:22.590687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ad8d7a3c-e9fd-4314-81cb-69a182871577 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.154444 Aug 25 03:07:22.591264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 87/189] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:22 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:23.611925 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:23.612551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:23.619547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:23.620027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:23.620480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:23.621165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:23.621700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:23.622122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:23.755544 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:23.764062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bef45795-33ed-469a-9030-1065e2e0638f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.155911 Aug 25 03:07:23.764653 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 103/190] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:23 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:24.425873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:24.426410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:24.433614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.434086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.434509 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.435183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.435625 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.436051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.450002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] HTTP exception thrown: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Request method failure captured: Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: DELETE /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 HTTP/1.1 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBucrC3uegdmOWsnzXbQumnXha4tTrR6jrm9EIao6cTZ3KokskScKbJtHzNQp6hrDD6BjOt2V9NJk8eEOk-pdElRtMhRqPGUGcO4z4tb9xcuceJ7D76G_9vYyxK7kwy9SXd_KLkFzZ_dIrpLSQXmzXUQIztmWGPkUQ1qSazeYWC_cXV8 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:07:24.451583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eeb0f7283fb84ea48fd468f22c721b8b"}]}] Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 4529d06c4eda48f788ce7c0327366377 Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.453010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'ed82b6fd-a60a-437b-880a-25b6424b88e1'} Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:07:24.453797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.455108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.456137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Returning 404 to user: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:07:24.456137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e00aba47-0669-43b3-b14e-26f58ea8d000 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 404 len: 111 microversion: 2.1 time: 0.030895 Aug 25 03:07:24.456137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 88/191] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:07:24 2022] DELETE /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:07:24.461718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:24.462321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] [instance: ed82b6fd-a60a-437b-880a-25b6424b88e1] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:24.468338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.468820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.469252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.470002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.470468 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.470886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.486751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] HTTP exception thrown: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Request method failure captured: Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 HTTP/1.1 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBucrC3uegdmOWsnzXbQumnXha4tTrR6jrm9EIao6cTZ3KokskScKbJtHzNQp6hrDD6BjOt2V9NJk8eEOk-pdElRtMhRqPGUGcO4z4tb9xcuceJ7D76G_9vYyxK7kwy9SXd_KLkFzZ_dIrpLSQXmzXUQIztmWGPkUQ1qSazeYWC_cXV8 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:07:24.488920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/eeb0f7283fb84ea48fd468f22c721b8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_eeb0f7283fb84ea48fd468f22c721b8b"}]}] Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: eeb0f7283fb84ea48fd468f22c721b8b Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-DeleteServersTestJSON-1039503589 Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 4529d06c4eda48f788ce7c0327366377 Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-DeleteServersTestJSON-1039503589-project Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.490330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'ed82b6fd-a60a-437b-880a-25b6424b88e1'} Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:07:24.491089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. Aug 25 03:07:24.493343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:07:24.494409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] Returning 404 to user: Instance ed82b6fd-a60a-437b-880a-25b6424b88e1 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:07:24.494409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5931bb94-1d29-4a75-a73f-cda62d689554 tempest-DeleteServersTestJSON-1039503589 tempest-DeleteServersTestJSON-1039503589-project] 10.222.0.75 "GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1" status: 404 len: 111 microversion: 2.1 time: 0.032743 Aug 25 03:07:24.494409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 104/192] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:24 2022] GET /compute/v2.1/servers/ed82b6fd-a60a-437b-880a-25b6424b88e1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:07:24.785425 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:24.786028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:24.792839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.793403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.793833 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.794522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:24.794965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:24.795486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:24.814806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:25.013876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-433539539", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "networks": [{"uuid": "df1df1b6-cd40-47b9-a838-b228d3f1c749"}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:25.070430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] validate_networks() for [('df1df1b6-cd40-47b9-a838-b228d3f1c749', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:07:25.097060 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:25.117007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a801756d-5f92-480b-8844-50a72fdf844a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.335262 Aug 25 03:07:25.123538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 89/193] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:24 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:25.471098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:07:25.471709 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:07:25.472406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:07:25.472821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:07:25.473379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:07:25.483146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:25.483658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:25.484112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:25.484841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:25.485291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:25.485844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:25.504053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Getting quotas for project d1f677a8a80e4591ab642d64f4008c00. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:07:25.509019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Getting quotas for user 1f2a411b051147e58a94dfa03413539b and project d1f677a8a80e4591ab642d64f4008c00. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:07:25.520357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:07:25.525430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:07:25.696217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ae92d5e7-e262-4ded-a71c-ed9e800423d3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686679 Aug 25 03:07:25.697140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 105/194] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:07:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:07:25.708039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad8d9508-fede-410e-9f98-95e56b67ed81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:25.709384 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ad8d9508-fede-410e-9f98-95e56b67ed81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:25.791317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ad8d9508-fede-410e-9f98-95e56b67ed81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:25.801587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ad8d9508-fede-410e-9f98-95e56b67ed81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1213 microversion: 2.1 time: 0.097111 Aug 25 03:07:25.802659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 90/195] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:25 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:26.148609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:26.149221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:26.155483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:26.155964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:26.156429 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:26.157131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:26.157577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:26.157996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:26.308784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:26.318246 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a9c7876d-7ad9-4650-9945-bc9dab916d3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.173422 Aug 25 03:07:26.318708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 106/196] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:26 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:26.827476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7acf598e-c532-41a4-9b33-7851f9f1bee7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:26.828653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7acf598e-c532-41a4-9b33-7851f9f1bee7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:26.912543 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7acf598e-c532-41a4-9b33-7851f9f1bee7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:26.920820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7acf598e-c532-41a4-9b33-7851f9f1bee7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1213 microversion: 2.1 time: 0.097222 Aug 25 03:07:26.922016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 91/197] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:26 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:27.339498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:27.340259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:27.346118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:27.346595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:27.347310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:27.347991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:27.348461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:27.348883 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:27.567050 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:27.576057 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-192b41a8-ee7f-4609-a6a8-32f1734481f1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.240898 Aug 25 03:07:27.576680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 107/198] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:27 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:27.941387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:27.942016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:27.948834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:27.949343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:27.949776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:27.950483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:27.950942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:27.951363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:28.031268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:28.040443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-284457d0-2536-4ff9-92e3-244a30fc3bfa tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1217 microversion: 2.1 time: 0.102844 Aug 25 03:07:28.041085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 92/199] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:27 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:28.597808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:28.599014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:28.606291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:28.606849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:28.607252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:28.613291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:28.613291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:28.613291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:28.765554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:28.780319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-33ee117b-5490-45e9-8a7a-5c8fe0a0da48 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.186616 Aug 25 03:07:28.780917 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 108/200] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:28 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:29.060623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:29.061222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:29.067935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:29.068447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:29.068911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:29.070342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:29.102589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:29.102589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:29.130088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:29.138625 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d55a45ff-feb1-4d8a-849b-f25433f56a45 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1217 microversion: 2.1 time: 0.081796 Aug 25 03:07:29.139211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 93/201] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:29 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:29.802407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:29.805083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:29.819895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:29.824638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:29.825506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:29.829690 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:29.829690 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:29.829690 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:29.835020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:29.994933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:30.002997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9748f48b-ca4e-4c11-b02c-26a703dc4b6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.205963 Aug 25 03:07:30.003641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 109/202] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:29 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:30.160228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:30.161344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:30.174241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:30.174723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:30.175146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:30.176769 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:30.177224 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:30.177694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:30.301328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:30.312888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8311b94c-740a-403b-beb6-7fbd031ee138 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1273 microversion: 2.1 time: 0.156887 Aug 25 03:07:30.327697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 94/203] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:30 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:31.028276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:31.029030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:31.040085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:31.041043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:31.041778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:31.043599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:31.044332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:31.044962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:31.244276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:31.258884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7e41028f-7d9d-4f41-8a1e-ccc0243d3e0c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.236663 Aug 25 03:07:31.259492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 110/204] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:31 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:31.339470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:31.342365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:31.354582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:31.355416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:31.356051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:31.357101 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:31.358083 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:31.358715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:31.566364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:31.579946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0e085515-8a6c-4706-81ab-cd8b12a4d1c7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.246159 Aug 25 03:07:31.580947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 95/205] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:31 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:31.970882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f559ed-7ff2-48ab-9669-08eec7fd0e89", "tag": "54acc277-867e-45c3-99af-e644503f3a0b"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:31.983591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:31.984988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:31.985773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:32.005750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] Creating event network-changed:54acc277-867e-45c3-99af-e644503f3a0b for instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 on hv-cinder-77957 Aug 25 03:07:32.013154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-3a690c63-e9ca-4616-af27-f18213e344c1 req-e1956173-14bb-42d1-b73f-d07d49633715 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046054 Aug 25 03:07:32.014478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 111/206] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:32.284184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:32.285182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:32.300192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:32.300192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:32.300192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:32.300192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:32.300941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:32.301367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:32.517152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:32.525533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-17949fcf-4843-49a5-848c-ad4200421bd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.248017 Aug 25 03:07:32.526434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 96/207] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:32 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:32.602142 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:32.603636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:32.610996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:32.611482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:32.611918 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:32.612831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:32.613610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:32.614221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:32.767107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:32.800679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-dab911f7-9995-427b-bbf6-7ea9f25ab5c0 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.199319 Aug 25 03:07:32.803346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 112/208] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:32 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:33.550016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:33.551718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:33.558811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:33.559334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:33.560268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:33.560707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:33.561159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:33.561568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:33.697308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:33.704872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fc491490-5e61-4039-8d85-4b08d6ba451c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.160884 Aug 25 03:07:33.705560 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 97/209] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:33 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:33.826818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:33.827424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:33.834712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:33.835865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:33.836341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:33.837035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:33.837483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:33.837902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:33.981264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:33.989255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-189ab056-826e-47e0-9b38-55d6d68c8d81 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.166986 Aug 25 03:07:33.989814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 113/210] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:33 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:34.726986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:34.730404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:34.738861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:34.739695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:34.740391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:34.741170 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:34.742291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:34.742939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:34.895274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:34.905235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3e1b6df7-26d5-4e84-a9a4-c964ab4a8f17 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.182604 Aug 25 03:07:34.905958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 98/211] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:34 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:35.010808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:35.011478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:35.022111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:35.025259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:35.025259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:35.025259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:35.025259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:35.026281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:35.190078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:35.199843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-52235ac1-946f-4db5-9139-642e36475cbb tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.193805 Aug 25 03:07:35.200467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 114/212] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:35 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:35.930039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:35.930623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:35.936972 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:35.937503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:35.943628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:35.943628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:35.943628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:35.943628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:36.078506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:36.090588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9cf21a3b-2a4b-4b4b-b0d1-66b7cbb3f346 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.165980 Aug 25 03:07:36.091293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 99/213] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:35 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:36.222430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:36.222430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:36.224842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:36.226233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:36.230134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:36.230855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:36.231416 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:36.238129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:36.238129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:36.238129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:36.409456 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:36.418649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f7f17f56-5ba8-4ad5-b786-9a851b5f6642 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.201480 Aug 25 03:07:36.419235 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 115/214] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:36 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:37.113933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:37.114533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:37.117046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.122269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:37.122751 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:37.123180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:37.123858 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:37.124354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:37.124775 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:37.268569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:37.279459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a1ddbfea-aa38-494d-9193-39c4836cd3d4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.169394 Aug 25 03:07:37.280029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 100/215] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:37 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:37.439848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:37.440476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:37.447605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:37.448083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:37.448535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:37.449223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:37.455397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:37.455397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:37.587224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:37.594606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e687ddc3-1d52-470f-a746-3031f6d520ca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.158881 Aug 25 03:07:37.595170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 116/216] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:37 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:38.300427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:38.301130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:38.308951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:38.309521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:38.310022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:38.310847 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:38.311368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:38.311879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:38.446524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:38.454615 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-781a9450-bbd4-4b04-88e7-ee53baf6f67a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.158259 Aug 25 03:07:38.455190 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 101/217] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:38 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:38.614773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:38.615370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:38.617658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.622737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:38.623211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:38.623638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:38.624349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:38.624794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:38.625207 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:38.763344 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:38.775517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c921ae4e-ccb3-4d85-85a4-2d597aae4249 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.164508 Aug 25 03:07:38.776351 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 117/218] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:38 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:39.477475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:39.478172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:39.486099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:39.486676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:39.487180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:39.487942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:39.488514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:39.488996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:39.659087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:39.659087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3aaec08a-2e69-4e92-8561-4ad11bc397a4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.168183 Aug 25 03:07:39.659087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 102/219] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:39 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:39.801860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:39.812192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:39.812192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:39.812192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:39.812192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:39.812560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:39.812560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:39.812560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:39.966094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:39.974147 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a23a6e19-31cd-4a01-a58b-0f85f2f18c6f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.176138 Aug 25 03:07:39.974749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 118/220] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:39 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:40.662274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:40.662871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:40.669606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:40.670080 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:40.670498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:40.671620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:40.671758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:40.672175 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:40.785818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f559ed-7ff2-48ab-9669-08eec7fd0e89", "name": "network-vif-plugged", "status": "completed", "tag": "54acc277-867e-45c3-99af-e644503f3a0b"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:40.797418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:40.798001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:40.798488 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:40.818705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] Creating event network-vif-plugged:54acc277-867e-45c3-99af-e644503f3a0b for instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 on hv-cinder-77957 Aug 25 03:07:40.825660 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-cb05d19d-605c-4719-9fd5-d35b0f46f786 req-18ef8505-d48d-402f-8261-7f4de462bcfb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043638 Aug 25 03:07:40.826432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 119/221] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:07:40.840854 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:40.850722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-98a6b4fa-99ca-45a0-ad0a-ca694decf353 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.192653 Aug 25 03:07:40.851433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 103/222] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:40 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:40.996160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:40.997121 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:41.004186 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:41.004924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:41.005385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:41.006122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:41.007076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:41.007508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:41.153367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:41.162530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2610e773-ea74-498a-8812-c6e443b131c2 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.170986 Aug 25 03:07:41.163687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 120/223] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:40 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:41.872741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:41.873369 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:41.879653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:41.880128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:41.880599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:41.881574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:41.882661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:41.883079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:42.022274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:42.027281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ef9b736f-c6f6-4694-94e2-ab78c3d6a83a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.158569 Aug 25 03:07:42.027953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 104/224] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:41 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:42.186519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:42.187123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:42.193782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:42.196420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:42.196420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:42.196420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:42.196420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:42.196789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:42.326680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:42.334525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3d099d5c-9058-4e3f-a8c7-e3f2cb3a6822 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.152137 Aug 25 03:07:42.339559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 121/225] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:42 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:43.048729 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:43.049388 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:43.056916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:43.057407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:43.057838 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:43.058528 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:43.059129 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:43.059556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:43.213094 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:43.221510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b34e90d1-5436-49eb-98be-09248024cf35 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.176519 Aug 25 03:07:43.222160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 105/226] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:43 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:43.356760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:43.357363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:43.364027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:43.364282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:43.364720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:43.365411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:43.365884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:43.366458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:43.502163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:43.511669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a2250c30-d53c-4b18-8e18-23fbb394a593 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.158863 Aug 25 03:07:43.512263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 122/227] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:43 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:44.244628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:44.245227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:44.251498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:44.251980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:44.252552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:44.253252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:44.253730 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:44.254202 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:44.392350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:44.401337 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a65c2219-29ef-4d8e-a3e6-b95b88c00c06 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.161108 Aug 25 03:07:44.401906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 106/228] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:44 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:07:44.533482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:44.534639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:44.542223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:44.543055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:44.543721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:44.544681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:44.545206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:44.545699 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:44.697105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:44.705093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c21d56f7-dd1f-4eae-91c3-c17a859f40d4 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.175550 Aug 25 03:07:44.708469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 123/229] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:44 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:45.424127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:45.429396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:45.432691 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:45.433173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:45.433605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:45.434323 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:45.434776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:45.435190 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:45.593616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:45.601947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2d08c8e2-54ca-495c-b463-dfc87568d822 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.181612 Aug 25 03:07:45.611151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 107/230] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:45 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:45.726441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:45.727059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:45.733291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:45.733804 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:45.734409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:45.735114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:45.735563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:45.735986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:46.119015 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:46.127142 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-39f06429-ca34-4d8d-bcb4-a2cecfcda442 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.405209 Aug 25 03:07:46.127936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 124/231] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:45 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:46.623261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:46.623933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:46.630349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:46.630828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:46.632168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:46.632887 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:46.633332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:46.633748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:46.637800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:46.784444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:46.792298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-715104b6-fde5-474c-97ae-ae65744903b7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.172857 Aug 25 03:07:46.792883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 108/232] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:46 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:47.152449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:47.152449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:47.157786 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:47.158542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:47.158980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:47.159688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:47.160133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:47.160629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:47.292826 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:47.300357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d607466c-0795-4703-9552-2767b73cc451 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.155332 Aug 25 03:07:47.300920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 125/233] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:47 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:47.816344 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:47.817061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:47.820173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=60 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:47.825089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:47.825574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:47.826004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:47.826695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:47.827140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:47.827560 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:47.954402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:47.963193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-58fef556-0ac9-4bc4-8662-b4cda69744be tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.150663 Aug 25 03:07:47.964015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 109/234] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:47 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:48.327559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:48.327559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:48.329889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:48.330392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:48.330806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:48.331518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:48.331974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:48.332429 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:48.469777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:48.477723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f9b5ab17-6ed7-4e73-9e76-ca0cbcc85331 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1313 microversion: 2.1 time: 0.158813 Aug 25 03:07:48.478373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 126/235] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:48 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:48.986741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:48.987369 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:48.995361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:48.998257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:48.998257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:48.998257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:48.998257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:48.998593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:49.155922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:49.167919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4f4ba79c-52b3-4bad-8643-2c516bdbbaa5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.181751 Aug 25 03:07:49.167919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 110/236] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:48 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:49.500331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:49.501073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:49.508820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:49.509273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:49.509705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:49.510399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:49.510852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:49.511405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:49.515674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:49.652900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:49.660863 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-49789dc6-bac7-4a37-a650-52c940aef056 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1496 microversion: 2.1 time: 0.164562 Aug 25 03:07:49.661364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 127/237] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:49 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:50.185875 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:50.186482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:50.193505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:50.194873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:50.195381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:50.196285 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:50.197189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:50.197811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:50.339392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:50.347444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-215eb3f6-2386-4c10-b9e1-1ee9a1072f5a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1521 microversion: 2.1 time: 0.165663 Aug 25 03:07:50.348093 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 111/238] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:50 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:51.369924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:51.370560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:51.376916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.380788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.380788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.380788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.380788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.382050 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.516942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:51.525063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4bdf03ba-dc06-4d7e-91df-87315cdaad4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1501 microversion: 2.1 time: 0.159485 Aug 25 03:07:51.525659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 128/239] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:51 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:51.549544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:51.550148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:51.557878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.558486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.558920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.559604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.560049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.560497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.728281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:51.736069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-df585493-2d9a-43af-9ad4-90a999d65482 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1515 microversion: 2.1 time: 0.190310 Aug 25 03:07:51.736862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 112/240] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:51 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:51.759276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:51.759780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:51.765994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.766480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.766921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.767610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:51.768310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:51.776106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:51.799751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:07:52.137122 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4b6f009f-a1a2-4aa3-b841-72f85d49f762 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 204 len: 0 microversion: 2.1 time: 0.382058 Aug 25 03:07:52.137650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 129/241] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:07:51 2022] DELETE /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:07:52.146015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:52.146709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:52.153621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:52.154111 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:52.154543 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:52.155632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:52.156091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:52.156592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:52.297731 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:52.306145 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-749f7876-52b4-4027-8760-b38cbf3d0ccf tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.164223 Aug 25 03:07:52.306722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 113/242] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:52 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:53.328775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:53.329388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:53.335741 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:53.336244 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:53.336674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:53.337360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:53.337801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:53.338218 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:53.471108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:53.480676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f0153fd8-6e7d-4b68-974e-7de16d27f888 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.155777 Aug 25 03:07:53.481134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 130/243] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:53 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:53.705991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:53.708363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:53.714913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:53.715471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:53.715908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:53.716631 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:53.717082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:53.717529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:53.740580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'flavor' on Instance uuid bbd488ac-822f-4fe0-9a52-b283ee2bea81 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:07:54.181514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a3006528-865b-4256-b546-f6b70fc86522 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/action" status: 200 len: 32 microversion: 2.1 time: 0.479521 Aug 25 03:07:54.182355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 114/244] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:07:53 2022] POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/action => generated 32 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:07:54.191358 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:54.191951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:54.198597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:54.199068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:54.199499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:54.200199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:54.200643 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:54.201061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:54.332197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:54.341351 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-efe461c5-fb22-4d93-b5d6-d9a754dfbe9c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.153675 Aug 25 03:07:54.342254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 131/245] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:54 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:54.502951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:54.503644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:54.511474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:54.514017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:54.514017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:54.514017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:54.514017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:54.514331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:54.666522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:54.674356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-af44239b-671d-4bee-829b-cb7d98ef350b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.175735 Aug 25 03:07:54.679561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 115/246] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:54 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:55.361950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:55.362482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:55.368846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:55.369324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:55.369751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:55.370431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:55.370875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:55.371291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:55.498030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:55.506277 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3a5dafe7-fdb7-4b00-9797-d4362456a4e0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.148045 Aug 25 03:07:55.507487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 132/247] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:55 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:55.695596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:55.696225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:55.702671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:55.703177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:55.703610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:55.704329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:55.704786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:55.705206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:55.833910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:55.842459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b40ca5b3-349b-4016-85a8-78334297910d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.151193 Aug 25 03:07:55.843012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 116/248] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:55 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:56.528840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:56.529359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:56.535293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:56.535780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:56.536271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:56.536964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:56.537415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:56.537844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:56.666006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:56.673733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2e512fde-6efb-4832-8fa8-c0c3650d0c61 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.148910 Aug 25 03:07:56.674330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 133/249] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:56 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:56.864260 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:56.864883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:56.871790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:56.872299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:56.872727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:56.873410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:56.873855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:56.874267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:57.008272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:57.015993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6d39d569-ebae-4cc5-ae2b-38cb2a5342f3 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.155553 Aug 25 03:07:57.016598 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 117/250] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:56 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:57.695663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:57.696394 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:57.703884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:57.704410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:57.704849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:57.705564 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:57.706106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:57.706539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:57.850200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:57.858042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a3fe515e-446a-482a-9593-555e855fa34d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.167015 Aug 25 03:07:57.858614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 134/251] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:57 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:58.037530 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:58.039897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:58.049786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:58.050308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:58.050748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:58.051452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:58.051898 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:58.052374 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:58.371391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:58.375232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f559ed-7ff2-48ab-9669-08eec7fd0e89", "name": "network-vif-deleted", "tag": "54acc277-867e-45c3-99af-e644503f3a0b"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:07:58.392188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-488d0bb4-4195-40b8-93d7-36f423ce2146 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1502 microversion: 2.1 time: 0.358889 Aug 25 03:07:58.392777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 118/252] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:58 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1502 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:58.397425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:58.398778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:58.399359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:58.412733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] Creating event network-vif-deleted:54acc277-867e-45c3-99af-e644503f3a0b for instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 on hv-cinder-77957 Aug 25 03:07:58.419613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-e040d908-3528-4f38-9b08-9c3adad6ef32 req-46ed5a68-63c0-4b89-8ce8-98340722d19d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054605 Aug 25 03:07:58.420641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 135/253] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:07:58.887058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:58.887682 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:58.893663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:58.894143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:58.894574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:58.895280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:58.895734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:58.896183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:59.040268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:59.048393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-79c96579-6b06-417c-9024-60afa670f135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.165238 Aug 25 03:07:59.048975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 119/254] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:58 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:07:59.415656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:07:59.416555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:07:59.422693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:59.423197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:59.423641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:59.424350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:59.424795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:59.425215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:59.456459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:07:59.456934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:07:59.457357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:07:59.457792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lazy-loading 'fault' on Instance uuid b9f559ed-7ff2-48ab-9669-08eec7fd0e89 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:07:59.502409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:07:59.511633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9e2e82a1-ebc5-432a-8e08-1343caccf114 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 200 len: 1303 microversion: 2.1 time: 0.100000 Aug 25 03:07:59.512231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 136/255] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:07:59 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:00.070993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:00.071498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:00.078400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:00.078901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:00.079345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:00.080106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:00.080590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:00.081011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:00.224836 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:00.233436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-93035fee-65c0-49c8-8306-20591b039aea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.167022 Aug 25 03:08:00.234016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 120/256] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:00 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:00.545022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:00.545633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: b9f559ed-7ff2-48ab-9669-08eec7fd0e89] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:00.551551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:00.552032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:00.552495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:00.553182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:00.553674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:00.554104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:00.567731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] HTTP exception thrown: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Request method failure captured: Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 HTTP/1.1 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBudpawYi8BYBw26vP0W0eYLV3BgNXbET0szsZiBp9k038sTHZEb0P_BASfJRrDZY28fBHvlDcKvtAcn1M9ci9Em0z9bjC9AoDvrlmp72gAc4igDvvt-BAGU3OlJq6739o_BJTAh9HRMah2zN9eWdCBXc3w0jeaHvxRHJqaVoI4wHlKw Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: d1f677a8a80e4591ab642d64f4008c00 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:08:00.569731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d1f677a8a80e4591ab642d64f4008c00"}]}] Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: d1f677a8a80e4591ab642d64f4008c00 Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesActionsTest-1145843969-project Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 1f2a411b051147e58a94dfa03413539b Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesActionsTest-1145843969-project Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. Aug 25 03:08:00.571476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'b9f559ed-7ff2-48ab-9669-08eec7fd0e89'} Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:08:00.572477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. Aug 25 03:08:00.573935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:00.575090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Returning 404 to user: Instance b9f559ed-7ff2-48ab-9669-08eec7fd0e89 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:08:00.575090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-96fd4e35-d91c-4e8d-bf9a-e53549cf5af9 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89" status: 404 len: 111 microversion: 2.1 time: 0.030191 Aug 25 03:08:00.575090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 137/257] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:00 2022] GET /compute/v2.1/servers/b9f559ed-7ff2-48ab-9669-08eec7fd0e89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:08:00.679604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1798908627", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "networks": [{"uuid": "df1df1b6-cd40-47b9-a838-b228d3f1c749"}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:00.735153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] validate_networks() for [('df1df1b6-cd40-47b9-a838-b228d3f1c749', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:08:01.115680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:08:01.115680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:08:01.115680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:08:01.115680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:08:01.115680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:08:01.125580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:01.126059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:01.126480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:01.127271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:01.127712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:01.128236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:01.145487 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Getting quotas for project d1f677a8a80e4591ab642d64f4008c00. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:08:01.150177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Getting quotas for user 1f2a411b051147e58a94dfa03413539b and project d1f677a8a80e4591ab642d64f4008c00. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:08:01.161259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:08:01.164400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:08:01.255100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:01.255700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:01.262112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:01.262592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:01.263019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:01.264050 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:01.264597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:01.265005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:01.401991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:01.410004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2c503bc4-26fc-46e7-8bce-2b4c1eb16815 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.158965 Aug 25 03:08:01.410560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 138/258] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:01 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:01.458754 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a36fa8eb-7bdb-4806-98b9-5780a965e54f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785138 Aug 25 03:08:01.459606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 121/259] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:08:01.471368 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1b4475c3-5f1e-4d4f-aa96-7abb6e42a11e tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:01.471966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1b4475c3-5f1e-4d4f-aa96-7abb6e42a11e tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:01.534156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1b4475c3-5f1e-4d4f-aa96-7abb6e42a11e tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:01.542678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1b4475c3-5f1e-4d4f-aa96-7abb6e42a11e tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1214 microversion: 2.1 time: 0.075109 Aug 25 03:08:01.543252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 139/260] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:01 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:02.434969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:02.435607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:02.442778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:02.443450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:02.443890 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:02.445360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:02.445816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:02.446241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:02.563020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:02.563753 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:02.570500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:02.571095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:02.571525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:02.572240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:02.572685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:02.573100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:02.583140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:02.591817 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ad703275-f2ef-4111-b651-98b64994eebe tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.160806 Aug 25 03:08:02.604210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 122/261] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:02 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:02.648581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:02.656172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6af28ac4-1f32-4a9a-96bb-4e8119957d57 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1218 microversion: 2.1 time: 0.097219 Aug 25 03:08:02.656748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 140/262] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:02 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:03.612699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:03.613313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:03.620635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:03.621120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:03.621553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:03.622243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:03.622702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:03.627718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:03.641899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:03.676353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:03.676997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:03.684044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:03.684564 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:03.685001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:03.685705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:03.686167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:03.686584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:03.750633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:03.758601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:03.759316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-17d0a524-2d52-4c6c-aa82-998cbdf15e64 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1218 microversion: 2.1 time: 0.086813 Aug 25 03:08:03.759909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 141/263] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:03 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:03.766431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bc10ef0c-ae42-4861-a705-a80db6d5dc6c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.157575 Aug 25 03:08:03.767008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 123/264] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:03 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:04.779685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:04.780330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:04.786379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:04.786911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:04.787345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:04.787565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:04.788065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:04.788406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:04.788505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:04.789115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:04.795826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:04.796345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:04.796782 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:04.797471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:04.797924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:04.798346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:04.851676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:04.859425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-50335752-eba7-4239-ba1c-838875d8db7a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1218 microversion: 2.1 time: 0.083565 Aug 25 03:08:04.860080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 142/265] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:04 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:04.939272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:04.947812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b383a736-b9b8-407a-9c4a-98c51232074f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.164470 Aug 25 03:08:04.948497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 124/266] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:04 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:05.880585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:05.881438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:05.887549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:05.888021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:05.888487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:05.889178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:05.889635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:05.890058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:05.956373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:05.965427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5ed8b445-8920-4158-9416-d7806cc28b95 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1266 microversion: 2.1 time: 0.088701 Aug 25 03:08:05.965991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 143/267] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:05 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:05.968597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:05.969359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:05.976694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:05.976694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:05.977085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:05.977767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:05.978211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:05.978627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:06.126771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:06.135692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2f2d71f6-138d-4cff-87b7-47dfae6cb134 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.170806 Aug 25 03:08:06.136359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 125/268] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:05 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:06.987086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:06.987726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:06.995185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:06.995735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:06.996193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:06.996945 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:06.997477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:06.997980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:07.002123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:07.060111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:07.068608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-052d3eb1-89ad-47b4-bb47-a6132a9b8a52 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1272 microversion: 2.1 time: 0.085418 Aug 25 03:08:07.076964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 144/269] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:06 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:07.158184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:07.158184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:07.164406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:07.164892 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:07.165312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:07.165997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:07.166619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:07.167057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:07.536896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:07.546076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8289c25f-a7ea-49a5-900f-2f35d237a062 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.392936 Aug 25 03:08:07.547095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 126/270] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:07 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:08.089904 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:08.090434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:08.097051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:08.097649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:08.098080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:08.098824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:08.099434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:08.099854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:08.297304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:08.302853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7231c6a-4833-4373-a9ca-2780b4b5c7f9", "tag": "303dcb01-a970-4833-8e89-6e9022f44c1e"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:08.306901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e662f415-06d5-4669-8b24-c2bed4db4c8d tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.220604 Aug 25 03:08:08.320184 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 145/271] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:08 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:08.327089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:08.327575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:08.328002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:08.340386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] Creating event network-changed:303dcb01-a970-4833-8e89-6e9022f44c1e for instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 on hv-cinder-77957 Aug 25 03:08:08.345016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-78f6ac60-4abb-4ce1-988c-01bc264192a3 req-d2c1fa04-8c53-4dbb-b2e1-6229359711fb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045759 Aug 25 03:08:08.345828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 127/272] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:08:08.566934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:08.567561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:08.575152 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:08.575634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:08.576096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:08.576812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:08.577264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:08.577689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:08.707873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:08.715708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-473b81c7-683e-4b3e-8701-1089daf8fbc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.152838 Aug 25 03:08:08.716296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 146/273] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:08 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:09.332061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:09.332813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:09.339711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:09.340218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:09.340652 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:09.341327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:09.341774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:09.342191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:09.477354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:09.485757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-73bec309-34a2-4da0-b457-0a5ce5c5db22 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.158313 Aug 25 03:08:09.486345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 128/274] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:09 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:09.739269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:09.740521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:09.751166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:09.751657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:09.752131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:09.753208 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:09.753950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:09.754531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:09.892104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:09.899877 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-083180dc-0ffc-4f71-a85f-fb0b42a570c2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.166677 Aug 25 03:08:09.900472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 147/275] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:09 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:10.508553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:10.509122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:10.515626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:10.516127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:10.516576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:10.517252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:10.517696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:10.518109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:10.691694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:10.700522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8eb5d26e-b5b1-4cb2-89a3-2245867dd422 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.196965 Aug 25 03:08:10.701083 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 129/276] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:10 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:10.922156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:10.922762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:10.930606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:10.931132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:10.931606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:10.932355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:10.932806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:10.933229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:11.213077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:11.220757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9298adfd-2569-4c5f-bee5-cc94175ec252 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.303143 Aug 25 03:08:11.221342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 148/277] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:10 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:11.575367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:11.575895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:11.577874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.578519 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.584052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:11.585201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:11.586456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:11.586838 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:11.587342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:11.587767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:11.613345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-675fdafe-11ea-4325-8a57-029941d9cc56 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/ips" status: 200 len: 145 microversion: 2.1 time: 0.042324 Aug 25 03:08:11.613920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 130/278] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:08:11 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:11.722327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:11.722860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:11.724743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.730168 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:11.730650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:11.731082 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:11.731762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:11.732243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:11.732664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:11.884047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:11.892603 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fbf1ca5b-9a05-4ecf-bbae-46beccad291f tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.174045 Aug 25 03:08:11.893171 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 149/279] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:11 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:12.246723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:12.247358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:12.254603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:12.255148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:12.255582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:12.256597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:12.257052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:12.257501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:12.423031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:12.431392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-52fdc227-11be-491b-bbb5-8511a5d1c339 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.188532 Aug 25 03:08:12.444183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 131/280] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:12 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:12.915559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:12.916206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:12.923040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:12.923529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:12.923971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:12.924710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:12.925275 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:12.925679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:13.086006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:13.094418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-40a0219c-83f8-42db-ba8d-363a6caba300 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.183485 Aug 25 03:08:13.094992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 150/281] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:12 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:13.453165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:13.453839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:13.461088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:13.461575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:13.462004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:13.462690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:13.463137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:13.463547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:13.621724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:13.629472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3b26607e-8c52-4da6-a087-b82f7cf309c5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.180282 Aug 25 03:08:13.630043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 132/282] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:13 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:14.116397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:14.117035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:14.118933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:14.124995 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.125492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.125926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.126995 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.127456 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.127882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.290096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:14.301992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0f638fc6-e5fc-4d12-84a1-d10bd1e7e601 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.186373 Aug 25 03:08:14.303153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 151/283] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:14 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:14.652400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:14.653002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:14.662353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.662969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.663528 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.668399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.668399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.668399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.681269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:14.682027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:14.689342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.690089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.690611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.691662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:14.692587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:14.693211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:14.720539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5c34a08b-601b-486b-bac5-647c9ca635d0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/ips" status: 200 len: 152 microversion: 2.20 time: 0.044101 Aug 25 03:08:14.737852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 152/284] 10.222.0.75 () {60 vars in 1289 bytes} [Thu Aug 25 03:08:14 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/ips => generated 152 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:08:14.830590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:14.839702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9ac1c7ad-79a2-4f59-87f2-7e8d7a2b6dd0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.191091 Aug 25 03:08:14.840828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 133/285] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:14 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:15.322772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:15.324390 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:15.331731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:15.335055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:15.335055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:15.335055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:15.335055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:15.335495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:15.528494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:15.541730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6ed74f14-48a8-458e-9ea9-bb0a3c744444 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.223522 Aug 25 03:08:15.542309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 153/286] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:15 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:15.861593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:15.862292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:15.869608 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:15.870166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:15.870670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:15.871481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:15.872031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:15.872535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:16.091816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:16.109218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3534cf64-d480-42b3-9691-a56969e0df03 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.251553 Aug 25 03:08:16.122564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 134/287] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:15 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:16.562489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:16.563290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:16.570846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:16.571480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:16.572013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:16.572993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:16.573648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:16.574136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:16.727184 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:16.737922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-154a2b47-1069-44fa-80d8-c776f9de5568 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.179280 Aug 25 03:08:16.738686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 154/288] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:16 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:16.783401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7231c6a-4833-4373-a9ca-2780b4b5c7f9", "name": "network-vif-plugged", "status": "completed", "tag": "303dcb01-a970-4833-8e89-6e9022f44c1e"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:16.793065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:16.793679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:16.794110 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:16.804777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] Creating event network-vif-plugged:303dcb01-a970-4833-8e89-6e9022f44c1e for instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 on hv-cinder-77957 Aug 25 03:08:16.809994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-4c540b33-66af-4ebb-a0c6-96131a3cff1c req-832441f1-f45b-42d2-9341-f69e4a500df2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 Aug 25 03:08:16.810604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 135/289] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:16.914631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cff1d21-e38e-4f52-9f1a-7ae7f6c95c9c"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:16.916984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:16.923522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:16.924287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:16.924723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:16.925956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:16.926571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:16.927133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:17.133660 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:17.134347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:17.140915 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:17.141811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:17.142278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:17.143214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:17.143661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:17.144079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:17.313561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:17.321644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2f763b78-c2b6-4d98-bd62-c1d90a4d570b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.194658 Aug 25 03:08:17.322268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 136/290] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:17 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:17.638659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:17.644565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:17.650500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:17.651120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:17.652241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:17.652964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:17.653421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:17.653902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:17.685386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lazy-loading 'flavor' on Instance uuid 650fe7f9-3642-4118-9da6-e217c1d9d1e6 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:08:18.319999 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bb3dd47f-d260-4dfd-bea9-ba923e38a454 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/action" status: 202 len: 0 microversion: 2.20 time: 0.689291 Aug 25 03:08:18.321822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 137/291] 10.222.0.75 () {62 vars in 1319 bytes} [Thu Aug 25 03:08:17 2022] POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:08:18.330290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:18.330995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:18.340115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.340516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.341174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.342139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.342602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.343025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.565260 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:18.574136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-87a85af6-8758-4705-b689-3a89826663bc tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.250891 Aug 25 03:08:18.574804 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 138/292] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:18 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:18.583456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:18.583456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:18.588082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.588592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.590448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.590448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.590448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.591363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.769295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-75ec0fa3-d049-4111-8437-f28a17f505e5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.859190 Aug 25 03:08:18.775528 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 155/293] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:08:16 2022] POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments => generated 194 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:18.784555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:18.788061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:18.806766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.807524 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.807688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.809153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:18.809806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:18.810423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:18.816356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:18.822945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:18.834142 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:18.836340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:18.838926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e1b6a059-bfd9-4a85-bec5-1fae094d4936 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.263102 Aug 25 03:08:18.839593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 139/294] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:18 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:19.076082 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:19.101023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bf892566-2e04-41fe-b760-47a549afeede tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.323086 Aug 25 03:08:19.101718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 156/295] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:18 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:19.595664 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:19.597621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:19.602731 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:19.613453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:19.615431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:19.616112 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:19.618399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:19.621055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:19.623691 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:19.779448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:19.790538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-475503f5-b313-4ebe-b39b-6eb68be4eb2c tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1314 microversion: 2.1 time: 0.199491 Aug 25 03:08:19.803639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 140/296] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:19 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:19.868189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:19.868953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:19.875729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:19.876392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:19.876835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:19.877539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:19.878059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:19.878480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.093956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:20.104491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:20.106905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:20.115602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7eb3b1cd-6f2d-43b2-b632-d0eea09d5b28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.245028 Aug 25 03:08:20.136857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:20.137598 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:20.142494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 157/297] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:19 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:20.144389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.145046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.145730 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.147865 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.148501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.149073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.324393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:20.338965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b164960d-c30e-4bee-be77-95b33fce4216 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1501 microversion: 2.1 time: 0.200580 Aug 25 03:08:20.361742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 141/298] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:20 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1501 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:20.376463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d49192d8-dfe1-49b0-9f3e-da53198f91e9"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:20.382074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:20.394177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.396952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.397624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.398813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.400069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.401395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.449648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] HTTP exception thrown: Cannot 'attach_volume' instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 while it is in vm_state rescued Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Request method failure captured: Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/os-volume_attachments HTTP/1.1 Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 74 Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBucpU8RUMeS449pGN11FAVpH-9_b7FTynxGl66lliI6ZBAMCljHcZQW0qCHHttc93uqHuQRCgwvBiNil4ZTvoLjysM1QcES1CegEVnIK99jTYnhO52FsK5I-7afZxLIDszMyOWy8uuDquZI2kypGG0btXlRozOu9UC2pcKGeVUeILMQ Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:08:20.451780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d5a66dfea4c5492da1ac3e1f76cbe35d"}]}] Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 7daac509316048ec903a5d78d3586aad Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {"volumeAttachment": {"volumeId": "d49192d8-dfe1-49b0-9f3e-da53198f91e9"}} Aug 25 03:08:20.452991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Cannot 'attach_volume' instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 while it is in vm_state rescued Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'server_id': 'bbd488ac-822f-4fe0-9a52-b283ee2bea81', 'body': {'volumeAttachment': {'volumeId': 'd49192d8-dfe1-49b0-9f3e-da53198f91e9'}}} Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:08:20.453722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 while it is in vm_state rescued Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:20.454792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:20.455845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:08:20.455845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:08:20.455845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 while it is in vm_state rescued Aug 25 03:08:20.455845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:08:20.458423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Returning 409 to user: Cannot 'attach_volume' instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 while it is in vm_state rescued {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:08:20.459673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-20cd13fa-12b5-4abe-bd31-a8b38a130127 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087907 Aug 25 03:08:20.464869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 158/299] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:08:20 2022] POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:08:20.469834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:20.474522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:20.484179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.484906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.485623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.486696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.487658 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.488377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.806999 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-171608f8-09c6-444a-bbe5-8be7258b3ac1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/action" status: 202 len: 0 microversion: 2.1 time: 0.340024 Aug 25 03:08:20.808373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 142/300] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:08:20 2022] POST /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:08:20.819577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:20.819834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:20.820969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:20.823416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:20.829885 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.830766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.831496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.833064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.833732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.834623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.840915 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.841692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.846018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:20.848338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:20.856246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:20.856246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:21.043487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:21.066501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c2f57791-ef96-4ee5-8e73-3d9b475d7d4b tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1498 microversion: 2.1 time: 0.259284 Aug 25 03:08:21.099262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 159/301] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:20 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1498 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:21.139160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:21.140043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:21.153372 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:21.154123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:21.154745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:21.155607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:21.156934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:21.158075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:21.170710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:21.251108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:21.261668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b0333390-b021-4b47-8da9-43d419ba41ae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1509 microversion: 2.1 time: 0.448225 Aug 25 03:08:21.266905 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 143/302] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:20 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:21.467548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:21.479223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:21.480976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:21.482202 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e908981d-aca8-426c-8922-a7dab5df99b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.347260 Aug 25 03:08:21.482758 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 160/303] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:21 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:22.325196 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:22.325795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:22.345977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.351140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.351140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.351140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.351140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.351628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.508769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:22.509406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:22.526638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.527137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.527765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.528730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.544929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.544929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.556377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:22.574764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-af480cc5-d5c6-4251-a524-052cf5747ea8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1509 microversion: 2.1 time: 0.254065 Aug 25 03:08:22.577666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 144/304] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:22 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:22.698430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:22.700841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:22.726444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.727062 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.727510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.728655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:22.729114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:22.729545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:22.769727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:08:22.851754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:22.883557 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:22.885106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:22.887096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-56f54643-1e6d-41b1-a7fb-d0b427ffbcd4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.384597 Aug 25 03:08:22.887096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 161/305] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:22 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:23.222808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bad38dbd-ec84-45a8-bc76-a07aaf178fca tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 204 len: 0 microversion: 2.1 time: 0.529971 Aug 25 03:08:23.223562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 145/306] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:08:22 2022] DELETE /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:08:23.232222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:23.235614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:23.239736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.240533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.241210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:23.242163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.242625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.243106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:23.544502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:23.555171 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a78dbc6c-8081-458b-aede-c173eb729930 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1504 microversion: 2.1 time: 0.326761 Aug 25 03:08:23.556105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 162/307] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:23 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:23.601851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:23.603326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:23.611692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.612421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.612856 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:23.614004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.614585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.615004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:23.777823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:23.786723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-56436ae6-8d8d-48a1-be3f-d7b26d95a17a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1509 microversion: 2.1 time: 0.191830 Aug 25 03:08:23.787388 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 146/308] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:23 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:23.913243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:23.917095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:23.922968 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.923525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.924060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:23.924829 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:23.925214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:23.925953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:24.111366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:24.122272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:24.124023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:24.125238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-94a9318d-975a-407e-b2d1-49c2e189786a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.216922 Aug 25 03:08:24.125781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 163/309] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:23 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:24.579609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:24.580312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:24.587431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:24.588266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:24.588901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:24.590668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:24.591482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:24.592084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:24.811546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:24.812891 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:24.822578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:24.826785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:24.827685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:24.828505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:24.829763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:24.830371 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:24.831284 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c7990d0e-e8b0-40c9-8ec5-538d0efe26ee tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1504 microversion: 2.1 time: 0.256516 Aug 25 03:08:24.844696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 147/310] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:24 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:24.845131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:25.090095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:25.101301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c95768b3-af65-46fa-b29e-d2de71b980b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1509 microversion: 2.1 time: 0.295144 Aug 25 03:08:25.102645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 164/311] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:24 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:25.149709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:25.150315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:25.158626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:25.159377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:25.160013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:25.160945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:25.161592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:25.162231 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:25.355435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:25.365086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:25.367143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:25.368463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1d049e34-0ef9-4efc-94bb-f59f601c0d9c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.223286 Aug 25 03:08:25.369425 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 148/312] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:25 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:25.855129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:25.855858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:25.863034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:25.863169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:25.863514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:25.864423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:25.864793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:25.865224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.049476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:26.058158 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-acd61785-0152-4498-9312-7beb93aa5576 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1504 microversion: 2.1 time: 0.207328 Aug 25 03:08:26.061908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 165/313] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:25 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:26.123644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:26.124060 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:26.133293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:26.134271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:26.134910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.135864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:26.136557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:26.137195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.364594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7231c6a-4833-4373-a9ca-2780b4b5c7f9", "name": "network-vif-deleted", "tag": "303dcb01-a970-4833-8e89-6e9022f44c1e"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:26.377587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:26.378102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:26.378595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.392473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] Creating event network-vif-deleted:303dcb01-a970-4833-8e89-6e9022f44c1e for instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 on hv-cinder-77957 Aug 25 03:08:26.398730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-a8c8bb0e-b001-4d45-8d09-5f1b695b0c49 req-ddf7669c-a8b6-4354-afe2-1979defe432e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040955 Aug 25 03:08:26.399699 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 166/314] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:26.405142 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:26.405834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:26.413563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:26.414054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:26.414487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.415197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:26.415647 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:26.416071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:26.468724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:26.499075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-44b110d8-6aca-41c7-9057-e10b75bc31e4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1515 microversion: 2.1 time: 0.380150 Aug 25 03:08:26.509804 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 149/315] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:26 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1515 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:26.693183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:26.706247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:26.713124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:26.713124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4c24c38f-cded-44b0-ad9e-2972fd526573 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.310411 Aug 25 03:08:26.713124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 167/316] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:26 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:27.095325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:27.101226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:27.107645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:27.110405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:27.111024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:27.112262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:27.113937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:27.116041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:27.158068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:27.158633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:27.158975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:27.159423 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lazy-loading 'fault' on Instance uuid a7231c6a-4833-4373-a9ca-2780b4b5c7f9 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:08:27.222203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f2a411b051147e58a94dfa03413539b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1f677a8a80e4591ab642d64f4008c00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:27.234981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bc57f32a-7d00-4227-a08b-46398043b8f7 tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 200 len: 1304 microversion: 2.1 time: 0.143922 Aug 25 03:08:27.236703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 150/317] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:27 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:27.739776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:27.746114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:27.751126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:27.751933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:27.753324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:27.754194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:27.754655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:27.755089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:27.951044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:27.961627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:27.963743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:27.965197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e2110c0e-a522-43f1-8186-2728d88bfb39 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.231403 Aug 25 03:08:27.965951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 168/318] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:27 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:28.263647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:28.264123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] [instance: a7231c6a-4833-4373-a9ca-2780b4b5c7f9] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:28.275040 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:28.276014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:28.277532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:28.296076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:28.297400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:28.297937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:28.304632 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:28.313854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:28.314350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:28.314470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] HTTP exception thrown: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Request method failure captured: Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 HTTP/1.1 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBudpawYi8BYBw26vP0W0eYLV3BgNXbET0szsZiBp9k038sTHZEb0P_BASfJRrDZY28fBHvlDcKvtAcn1M9ci9Em0z9bjC9AoDvrlmp72gAc4igDvvt-BAGU3OlJq6739o_BJTAh9HRMah2zN9eWdCBXc3w0jeaHvxRHJqaVoI4wHlKw Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: d1f677a8a80e4591ab642d64f4008c00 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:08:28.316574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d1f677a8a80e4591ab642d64f4008c00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d1f677a8a80e4591ab642d64f4008c00"}]}] Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: d1f677a8a80e4591ab642d64f4008c00 Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-VolumesActionsTest-1145843969 Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-VolumesActionsTest-1145843969-project Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 1f2a411b051147e58a94dfa03413539b Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-VolumesActionsTest-1145843969-project Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. Aug 25 03:08:28.317873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'a7231c6a-4833-4373-a9ca-2780b4b5c7f9'} Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:08:28.319126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. Aug 25 03:08:28.321165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:08:28.322940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] Returning 404 to user: Instance a7231c6a-4833-4373-a9ca-2780b4b5c7f9 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:08:28.322940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-80488222-63ee-4e80-8f62-959e6f00375a tempest-VolumesActionsTest-1145843969 tempest-VolumesActionsTest-1145843969-project] 10.222.0.75 "GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9" status: 404 len: 111 microversion: 2.1 time: 0.061087 Aug 25 03:08:28.322940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 151/319] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:28 2022] GET /compute/v2.1/servers/a7231c6a-4833-4373-a9ca-2780b4b5c7f9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:08:28.325210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:28.419742 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Going to try to stop instance {{(pid=121256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 03:08:28.694247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-31463e02-7c0b-4f4b-b856-0bf6cf34746a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action" status: 202 len: 0 microversion: 2.1 time: 0.387942 Aug 25 03:08:28.694247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 169/320] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:08:28 2022] POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:08:28.696355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:28.697181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:28.704758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:28.705535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:28.706247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:28.707202 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:28.716944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:28.718674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:28.917820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:28.930651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f8a6a879-0f1d-496e-b460-60237aee0cbd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.241537 Aug 25 03:08:28.944392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 152/321] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:28 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:28.993725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:28.998433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:29.016993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:29.017494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:29.017934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:29.018651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:29.019101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:29.019524 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:29.225225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:29.234194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:29.238981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:29.238981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a3ad968c-9008-4a02-8ac5-08eabf779d4b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.251694 Aug 25 03:08:29.238981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 170/322] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:28 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:29.286912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-50441933-71ad-45ab-880a-a7a3396c8e7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: .version_select at 0x7ff193df8670>, body: {"keypair": {"name": "tempest-keypair-301131760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAInKkHsNWxjj3rOx6jEkZsSyKx4nLFrPI7kWrC94lSkxcwoxNRdIqpCsFYaj38e3Sn+KGS+diDF+r91g5RvDCiUjZpIp2wGki/hqE/H7owjYDJjwuE8G/gRWdM3iEDnlA=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:29.315366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-50441933-71ad-45ab-880a-a7a3396c8e7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:08:29.320683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-50441933-71ad-45ab-880a-a7a3396c8e7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for user 7daac509316048ec903a5d78d3586aad and project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:08:29.471524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-50441933-71ad-45ab-880a-a7a3396c8e7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188430 Aug 25 03:08:29.472476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 153/323] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:08:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:29.953518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:29.960840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:29.972523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:29.973244 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:29.974175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:29.977322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:29.977900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:29.990989 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:30.204962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:30.228600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a85767f9-0b30-4bf2-9d50-39939ad905db tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.278811 Aug 25 03:08:30.237857 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 171/324] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:29 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:30.263135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:30.265186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:30.277190 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:30.280356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:30.284947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:30.284947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:30.284947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:30.286968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:30.779514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:30.805690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:30.807418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:30.809315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5f78a9ac-3029-470f-856f-e04c8bfb9055 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.550177 Aug 25 03:08:30.810008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 154/325] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:30 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:31.261232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:31.261891 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:31.268671 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:31.269388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:31.269977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:31.270855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:31.271530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:31.272186 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:31.483148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:31.493445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-75a8930f-3fa3-4133-b865-413ea3b77d5a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.235636 Aug 25 03:08:31.494644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 172/326] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:31 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:31.847766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:31.848497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:31.856811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:31.857685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:31.858181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:31.858940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:31.859452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:31.859935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:31.864436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:32.179158 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:32.187974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:32.189504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:32.190889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-692425f3-76e4-49dd-9fd2-ff6becf4d505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.347135 Aug 25 03:08:32.195713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 155/327] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:31 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:32.515211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:32.515927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:32.523849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:32.524903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:32.525083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:32.525870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:32.526418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:32.527050 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:32.993676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-270849150", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e41fd9c3-0d17-460e-a746-06b7f7aecf81"}], "security_groups": [{"name": "tempest-securitygroup--247775507"}], "key_name": "tempest-keypair-301131760", "user_data": "}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:33.137532 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:33.147284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9dd8c4da-194c-45c1-8cb1-51b4ab28205a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.636103 Aug 25 03:08:33.147875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 173/328] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:32 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:33.165922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] validate_networks() for [('e41fd9c3-0d17-460e-a746-06b7f7aecf81', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:08:33.218941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:33.219547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:33.231248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:33.231753 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:33.232212 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:33.232948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:33.233401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:33.240095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:33.505826 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:33.519849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:33.523169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:33.524773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fecbe6f4-82ea-4435-881e-2355c7f4eb54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.309868 Aug 25 03:08:33.525342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 174/329] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:33 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:33.702370 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:08:33.702885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:08:33.703552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:08:33.704067 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:08:33.704613 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:08:33.717011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:33.717716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:33.718213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:33.718998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:33.719513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:33.719998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:33.742192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:08:33.746279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Getting quotas for user 7daac509316048ec903a5d78d3586aad and project d5a66dfea4c5492da1ac3e1f76cbe35d. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:08:33.758395 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:08:33.760663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:08:33.919164 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9000938b-0e1a-431e-82dd-83540db9a6d5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.931382 Aug 25 03:08:33.920728 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 156/330] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:08:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:08:33.937644 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a9717f6c-92f0-4fe3-a9f3-0e584668f1eb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:33.938262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a9717f6c-92f0-4fe3-a9f3-0e584668f1eb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:34.003641 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a9717f6c-92f0-4fe3-a9f3-0e584668f1eb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:34.014194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a9717f6c-92f0-4fe3-a9f3-0e584668f1eb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1244 microversion: 2.1 time: 0.085355 Aug 25 03:08:34.014778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 157/331] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:33 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:34.031968 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1a362656-7ade-427b-a5ee-fde6cfc4b3f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Action: 'create', calling method: .version_select at 0x7ff197bb4160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1103826834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWBFe+3NhQdS+EN16u/KTfUS71tfBnU/9ZEFOV2FLadmVJm9e0/KZmvzp10tjszIU5ebd/l+OSdagPU7jbygFnTPDNcVLt0jrs72zrxVFctqNNz001aJsHmkd/ZizIWoA=="}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:34.047746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-1a362656-7ade-427b-a5ee-fde6cfc4b3f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Getting quotas for project 54df2648916c4681af69062a1d5b7430. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:08:34.057248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-1a362656-7ade-427b-a5ee-fde6cfc4b3f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Getting quotas for user 2927c54860d840538bab1004441c104b and project 54df2648916c4681af69062a1d5b7430. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:08:34.168215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1a362656-7ade-427b-a5ee-fde6cfc4b3f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.353228 Aug 25 03:08:34.168812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 175/332] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:08:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:08:34.173920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:34.173920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:34.177470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:34.178656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:34.179162 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:34.181033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:34.181398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:34.181891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:34.335205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:34.343783 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e5fe2038-4fda-4c5d-be9f-6c6757c36b64 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.177766 Aug 25 03:08:34.344694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 158/333] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:34 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:34.553442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:34.554147 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:34.561598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:34.562194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:34.562697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:34.563454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:34.563968 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:34.564650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:34.759603 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:34.777637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:34.783783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:34.785105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e89a06cf-2624-4e29-bd38-50ae6df27758 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.236122 Aug 25 03:08:34.796903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 176/334] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:34 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:35.037741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4077b1f5-519b-4fa8-aea0-5f4a6f55c6ba tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:35.038720 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4077b1f5-519b-4fa8-aea0-5f4a6f55c6ba tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:35.134349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4077b1f5-519b-4fa8-aea0-5f4a6f55c6ba tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:35.142445 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4077b1f5-519b-4fa8-aea0-5f4a6f55c6ba tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1244 microversion: 2.1 time: 0.109135 Aug 25 03:08:35.144603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 159/335] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:35 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:35.366024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:35.367023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:35.373919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:35.374613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:35.375065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:35.375821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:35.376232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:35.376658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:35.420333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:35.671978 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:35.720607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-55e6809f-dd38-4372-9fc1-4c804cedf49b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.349108 Aug 25 03:08:35.723027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 177/336] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:35 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:35.816416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:35.817408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:35.829130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:35.829663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:35.830488 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:35.831415 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:35.831926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:35.832503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:36.137615 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:36.150781 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:36.152543 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:36.153911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fd02bdc2-cca9-42b8-a150-6569715f3ccc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1743 microversion: 2.20 time: 0.345321 Aug 25 03:08:36.154520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 160/337] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:35 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1743 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:36.172133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:36.173779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:36.184659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:36.185484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:36.186108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:36.187138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:36.187758 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:36.188386 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:36.260191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:36.269163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8ba7781d-01f0-4890-9915-3208073d703e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1240 microversion: 2.1 time: 0.101501 Aug 25 03:08:36.280624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 178/338] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:36 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1240 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:36.746178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:36.747059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:36.753916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:36.754429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:36.754860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:36.756026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:36.756800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:36.757534 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:36.995524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:37.008069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-56d3f0da-adfa-42c4-88eb-a329a9960d2a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.265811 Aug 25 03:08:37.008930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 161/339] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:36 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:37.179889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:37.180561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:37.187600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:37.188102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:37.188705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:37.189444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:37.189904 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:37.190374 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:37.292837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:37.294018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:37.301610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:37.302113 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:37.302799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:37.303828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:37.304512 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:37.305100 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:37.361256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:37.370689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:37.372209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:37.373391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f33a86b1-c2d5-45d3-8d8c-36c222c81eb7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1743 microversion: 2.20 time: 0.198278 Aug 25 03:08:37.373936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 179/340] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:37 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:37.382197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:37.390307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c48b37f2-2a16-4ac0-90ef-320b9c88436a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1296 microversion: 2.1 time: 0.102185 Aug 25 03:08:37.390897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 162/341] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:37 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:38.029566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:38.030170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:38.036470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.037590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.038160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.038851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.039302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.039746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.184230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:38.195125 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-28a72451-1ddb-4ebd-a844-837f3317d142 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.170276 Aug 25 03:08:38.195711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 180/342] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:38 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:38.398748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:38.407225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:38.407225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.407225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.407225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.407586 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.407762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.408439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.412771 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:38.413500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:38.419629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.420109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.420672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.421399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:38.421833 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:38.422441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:38.487973 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:38.496133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-310b00b0-7591-4cb9-81c4-1dd99d702fc3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1296 microversion: 2.1 time: 0.087513 Aug 25 03:08:38.496929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 181/343] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:38 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:38.547829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:38.556471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:38.557965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:38.559108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5ae5592c-e6c2-4101-9d71-4ff99985ca8e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1743 microversion: 2.20 time: 0.165441 Aug 25 03:08:38.559674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 163/344] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:38 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:39.217445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:39.218113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:39.226086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.226555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.226983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.227662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.228107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.228548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.358407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:39.366680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e11f2e25-bee3-43ed-949f-e90676d8553e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.153328 Aug 25 03:08:39.367328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 182/345] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:39 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:39.518398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:39.519007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:39.526049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.526539 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.526978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.527663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.528118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.528569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.581689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:39.582283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:39.589433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.589433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.589866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.590916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:39.591378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:39.591779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:39.592335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:39.602577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0e508e10-de51-4664-a656-f881030d5878 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1296 microversion: 2.1 time: 0.087947 Aug 25 03:08:39.612365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 164/346] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:39 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:39.733675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:39.741924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:39.743434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:39.744727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1f6a47fb-d33e-407e-a772-4d9506f1a864 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1743 microversion: 2.20 time: 0.166960 Aug 25 03:08:39.745281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 183/347] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:39 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:40.389404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:40.390340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:40.402367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.403119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.403924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.407602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.407602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.407602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.624712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:40.625365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:40.635100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.636133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.636609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.637570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.638324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.638740 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.663485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:40.685634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cd842d38-4fea-4efc-b1fa-c3c2a101aa18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.299939 Aug 25 03:08:40.697654 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 165/348] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:40 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:40.768072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:40.768713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:40.786501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.793427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.797183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.801587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:40.802318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:40.803018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:40.805243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:40.824329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d9540cb8-56dd-4387-bce4-3d97a4ea459e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1304 microversion: 2.1 time: 0.202275 Aug 25 03:08:40.825851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 184/349] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:40 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1304 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:41.135930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:41.148450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:41.149955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:41.151201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c7a0bc3b-461b-4e24-a56f-181332247412 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1743 microversion: 2.20 time: 0.387296 Aug 25 03:08:41.178366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 166/350] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:40 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1743 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:41.537948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "name": "network-vif-plugged", "status": "completed", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:41.552573 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:41.553956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:41.554512 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:41.567661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] Creating event network-vif-plugged:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:08:41.574001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-1cc7d285-566a-46ab-8d74-685cf7b2fa27 req-d112e088-a551-4c7f-b03a-ec21f259f050 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040840 Aug 25 03:08:41.577838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 185/351] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:41.710106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:41.711364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:41.720286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:41.720918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:41.722082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:41.723327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:41.725197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:41.725907 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:41.850624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:41.851341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:41.865172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:41.871063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:41.871516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:41.872297 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:41.872903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:41.873529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:41.983285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:41.993879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-79d0d385-0e70-496c-8707-0f1fcc7e9e37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1302 microversion: 2.1 time: 0.148806 Aug 25 03:08:42.001404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 186/352] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:41 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1302 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:42.009684 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:42.018180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5711ccf5-91b9-4a8e-b730-3b537b41abd7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.312723 Aug 25 03:08:42.037906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 167/353] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:41 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:42.181270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:42.182086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:42.188631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:42.189215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:42.189843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:42.190559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:42.191021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:42.191454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:42.470637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:42.496074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:42.496074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:42.496074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5b528652-09de-49c1-9812-fa8889bfeb0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.306199 Aug 25 03:08:42.496388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 187/354] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:42 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:43.015366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:43.016542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:43.027140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.028001 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.029498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.030846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.031505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.032114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.042801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:43.043391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:43.050151 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.050631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.056664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.058610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.060196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.060799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.220174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:43.230514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-451527fd-9d69-4312-b8b2-bbe45d0a366b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.190796 Aug 25 03:08:43.241111 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:43.248648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 188/355] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:43 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:43.255264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-58be195d-c47e-4d6e-8757-f6c13e64d62f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.243811 Aug 25 03:08:43.258593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 168/356] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:43 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:43.522811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:43.523413 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:43.532066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.532589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.533013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.537537 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.541159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.543472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.700682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:43.710734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:43.713017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:43.714919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-55d84c24-182e-425e-9dbc-0e592499eb98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.195840 Aug 25 03:08:43.715373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 189/357] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:43 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:43.746356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:43.752377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:43.760977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:43.761790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:43.762955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:43.777329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] Creating event network-changed:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:08:43.783263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-d33be49a-de51-4d3b-8147-957b69f83482 req-3d60e07d-fb49-489c-af4a-4f49c767502f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040995 Aug 25 03:08:43.784447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 169/358] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:08:44.256371 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:44.256969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:44.259615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=4 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:44.264433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.264983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.265505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.266257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.266832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.267363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.290529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:44.291086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:44.298273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.299156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.299875 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.300771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.301398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.301975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.418795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:44.428197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0eaabffb-d35a-4693-aafe-82e1bf2ce160 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.175982 Aug 25 03:08:44.429342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 190/359] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:44 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:44.474759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:44.484185 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-eab2435f-a6f9-4718-b7d8-35f2880fb103 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.198551 Aug 25 03:08:44.484757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 170/360] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:44 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:44.738983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:44.739593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:44.746314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.746808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.747250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.747940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:44.748423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:44.748850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:44.899531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:44.907628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:44.909164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:44.910308 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e129bc84-ef19-4838-8a08-b2dcc9e91bf1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.175358 Aug 25 03:08:44.911070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 191/361] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:44 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:45.452532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:45.453201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:45.456781 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=14 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:45.458317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:45.462708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.463417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.463709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:45.464772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.466328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.477042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:45.508257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:45.509491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:45.512123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:45.518245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.518743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.519184 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:45.520169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.520814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.522308 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:45.647354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:45.659140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-59ce257a-03bd-4015-a1d9-8169dae2fa29 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.210606 Aug 25 03:08:45.666035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 171/362] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:45 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:45.691376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:45.703907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5c7847d9-de8f-45be-81c9-e8e0f66e8db3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.200707 Aug 25 03:08:45.721465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 192/363] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:45 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:45.934918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:45.935693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:45.942561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.943977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.944687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:45.945515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:45.946013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:45.946876 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:46.114119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:46.124555 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:46.126140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:46.127330 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5b72fbde-b2e4-4e01-b0da-55dd5bdb1b31 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.197225 Aug 25 03:08:46.140171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 172/364] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:45 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:46.686106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:46.687463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:46.695428 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:46.702815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:46.703264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:46.704229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:46.704844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:46.705634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:46.732092 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:46.737806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:46.746423 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:46.746945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:46.747386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:46.748106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:46.748590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:46.749026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:46.946553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:46.958383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3f928af9-2c86-4026-bef8-b21d5aa50c18 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.275958 Aug 25 03:08:46.967055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 193/365] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:46 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:47.056669 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:47.066161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7fedf831-5a2d-4f77-97ca-4a1e04cb335b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.337065 Aug 25 03:08:47.067143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 173/366] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:46 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:47.156073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:47.157623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:47.166572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:47.169708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:47.170166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:47.175511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:47.175511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:47.175511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:47.351268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:47.354996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:47.360813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:47.362476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:47.363842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8b4c60e4-7a08-4367-a9ba-bb0569bec887 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.214356 Aug 25 03:08:47.364549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 194/367] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:47 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:47.981628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:47.982430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:47.989524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:47.991554 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:47.991554 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:47.991812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:47.992289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:47.992877 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:48.089728 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:48.092806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:48.098224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:48.099189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:48.099688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:48.100941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:48.101464 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:48.102153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:48.137290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:48.146072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f17f43a0-b287-4b25-9edb-5c2133082935 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.168784 Aug 25 03:08:48.147401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 174/368] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:47 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:48.260804 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:48.268752 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-59508438-ccd4-41fa-8b96-a7a0d08c541d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.183265 Aug 25 03:08:48.283134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 195/369] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:48 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:48.388717 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:48.389454 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:48.395292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:48.395777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:48.396290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:48.397136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:48.397641 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:48.398063 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:48.402204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:48.539980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:48.549506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:48.551176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:48.557199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2d73d73a-3118-471a-836d-f58f584a8f77 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.167494 Aug 25 03:08:48.557199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 175/370] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:48 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:49.168859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:49.169494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:49.176208 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.176916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.177774 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.178236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.178679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.179093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.296875 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:49.297498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:49.308430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.308927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.309355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.311825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.319073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.319564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.329009 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:49.338116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-69ea1be3-b9b9-450c-8422-8bb8e88c0eb0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.173288 Aug 25 03:08:49.338685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 196/371] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:49 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:49.504037 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:49.517750 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cc9db371-79b6-4a24-850d-a0ffee4ef58d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.228899 Aug 25 03:08:49.533211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 176/372] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:49 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:49.577341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:49.578232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:49.585656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.586433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.586872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.587564 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:49.588230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:49.588608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:49.732023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:49.740469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:49.741962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:49.743336 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d08ae87e-4944-4fe1-9a65-0ab1d5a8e17c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.170119 Aug 25 03:08:49.744053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 197/373] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:49 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:50.363981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:50.365437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:50.373517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.374278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.375323 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:50.376480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.377278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.378065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:50.544430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:50.546619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:50.561846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:50.565905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.566693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.567626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:50.569885 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.570473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.571602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:50.572802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e847aa4d-0837-43c0-919d-a4bf46234558 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1722 microversion: 2.1 time: 0.214265 Aug 25 03:08:50.573926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 177/374] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:50 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:50.775963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:50.777700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:50.787353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:50.797591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-21a73d3f-bebf-4cd7-a68b-e00293a6bdc5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.261001 Aug 25 03:08:50.799141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 198/375] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:50 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:50.808948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.809476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.810033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:50.810961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:50.811432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:50.820380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.040845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:51.057845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:51.064115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:51.064115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-de6601f6-0636-4682-a7d1-797602f408a3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.291713 Aug 25 03:08:51.064115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 178/376] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:50 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:51.596045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:51.597498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:51.605341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:51.605863 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:51.606287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.607196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:51.607800 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:51.608420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.789452 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:51.798300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7e4c340c-8558-4e9c-94d9-160de16b2a9c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1699 microversion: 2.1 time: 0.206704 Aug 25 03:08:51.798984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 199/377] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:51 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1699 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:51.822932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:51.827756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:51.835200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:08:51.842387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:51.842978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:51.843415 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.844403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:51.848772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:51.848772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.850258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:51.852341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:51.853163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:51.891985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Going to try to start instance {{(pid=121256) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 03:08:52.007476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:52.016182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d4537e57-334f-4ecc-ac9f-2a5819da3952 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.199289 Aug 25 03:08:52.016943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 179/378] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:51 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:52.087438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:52.088323 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:52.101149 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:52.101756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:52.107192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:52.107192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:52.107192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:52.107192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:52.141658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-28ead83e-a9f9-4fe6-9fe7-990e6aa8f775 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action" status: 202 len: 0 microversion: 2.1 time: 0.314986 Aug 25 03:08:52.142778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 200/379] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:08:51 2022] POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:08:52.171078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:52.172861 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:52.181224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:52.182281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:52.183067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:52.183930 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:52.184578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:52.185382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:52.278799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:52.288462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:52.290338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:52.291693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-779da080-153c-4377-8ecf-06924414e655 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.209063 Aug 25 03:08:52.292796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 180/380] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:52 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:08:52.370975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:52.382444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2e7e9bb1-a672-43a6-be61-63199548323f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1708 microversion: 2.1 time: 0.233764 Aug 25 03:08:52.383117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 201/381] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:52 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1708 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:53.053710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:53.053710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:53.053710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.053710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.054679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.054679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.054679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.054679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.194498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:53.204229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-73e86360-f477-4e41-8f5d-5f6457ab0633 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.169756 Aug 25 03:08:53.205062 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 181/382] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:53 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:53.316226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:53.318445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:53.338543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.339329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.339985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.341020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.341656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.342224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.405350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:53.406756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:53.415841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.418500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.419451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.420482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:53.421042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:53.421732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:53.547597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:53.558508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:53.560081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:53.563585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b209a45b-ad2a-4bbf-aa6e-8feed76a8be1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.249167 Aug 25 03:08:53.564333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 202/383] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:53 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:53.607156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:53.617498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6758f62e-b4e0-4304-abd7-546c299200d1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1708 microversion: 2.1 time: 0.215989 Aug 25 03:08:53.633315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 182/384] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:53 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1708 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:54.227565 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:54.228322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:54.234388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.234864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.235291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.236028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.236511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.236928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.406325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:54.416460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0618efed-edb5-40f7-83a7-f6ec93d7d368 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.193220 Aug 25 03:08:54.417297 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 203/385] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:54 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:54.587335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:54.588895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:54.598524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.600063 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.600985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.601947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.602472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.602957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.639290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:54.640030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:54.658022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.658022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.658022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.658022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:54.658382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:54.662044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:54.759315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:54.770437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:54.772761 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:54.775749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-967a3b87-0f41-49bb-8b3d-1d17f89c3f59 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.192641 Aug 25 03:08:54.777961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 183/386] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:54 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:54.895006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:54.908062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f860cb9d-e245-4d3f-b358-1eb39a6452f3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1708 microversion: 2.1 time: 0.272686 Aug 25 03:08:54.908583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 204/387] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:54 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1708 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:55.441046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:55.441934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:55.449981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.450572 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.451156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:55.452250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.453404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.454597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:55.750851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:55.759482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-588699a0-3fed-4eda-91f2-fcf0feb224e6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.325173 Aug 25 03:08:55.760079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 184/388] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:55 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:55.798793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:55.799629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:55.807621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.808397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.809475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:55.810425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.811074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.811494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:55.933712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:55.936686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:55.951917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.955102 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.955102 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:55.957703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:55.959194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:55.960312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:56.016102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:56.027651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:56.029873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:56.031639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-70cc241f-8938-4a88-9383-2f38481b7d13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.236706 Aug 25 03:08:56.032903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 205/389] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:55 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:56.226848 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:56.236214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-75dd729e-3b05-4797-b9d9-0c8130a8088a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1708 microversion: 2.1 time: 0.309959 Aug 25 03:08:56.237047 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 185/390] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:55 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1708 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:08:56.784894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:56.785310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:56.796901 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:56.797871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:56.798494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:56.799367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:56.800452 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:56.801058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:56.974219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:56.982392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9a878326-5f38-4aaa-8c38-2e07b32d1936 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.201566 Aug 25 03:08:56.986645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 206/391] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:56 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:57.054985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:57.056394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:57.093311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:57.093311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:57.093311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:57.093311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:57.093643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:57.093643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:57.219462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:57.228695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:57.230193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:57.231437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cc70a597-afba-4f21-9468-5974b4306e2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.180686 Aug 25 03:08:57.231990 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 186/392] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:57 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:57.266808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:57.271744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:57.281773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:57.289343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:57.289343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:57.289343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:57.289343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:57.289790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:57.470351 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:57.481986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-16c6dcfd-3967-4ba8-857e-3d9223f026c9 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1708 microversion: 2.1 time: 0.223495 Aug 25 03:08:57.483047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 207/393] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:57 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1708 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:58.003520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:58.004124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:58.012000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.012599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.013081 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.013791 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.014243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.014665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.218403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:58.227214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1876d201-a903-4a09-92fc-9d79f2a40384 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.227615 Aug 25 03:08:58.227913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 187/394] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:57 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:58.254197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:58.255914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:58.262581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.263051 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.263476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.264242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.269344 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.269344 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.405955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:58.415333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:58.416893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:58.418162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3367c32c-69a8-4179-a60a-b5642c28307f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.167959 Aug 25 03:08:58.446499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 208/395] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:58 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:08:58.506101 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:58.507055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:58.517792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.519540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.520138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.522839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:58.523789 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:58.524570 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:58.685084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:58.694322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-17754c07-457a-47ce-bf91-d20e40ddeb40 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1712 microversion: 2.1 time: 0.192551 Aug 25 03:08:58.708315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 188/396] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:58 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1712 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:59.251273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:59.252172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:59.263777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:59.264830 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:59.265736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:59.266876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:59.267604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:59.268527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:59.463482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:08:59.466413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:08:59.481957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:59.493069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7b5e32a7-1dbd-451f-beaa-57aa3e5deb7e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.246014 Aug 25 03:08:59.494347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:59.495230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 209/397] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:08:59 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:08:59.517846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:59.519386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:59.521322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:08:59.522486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:08:59.523314 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:08:59.749709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:59.762683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:59.764439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:08:59.765603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6a384e29-6885-41d2-b53a-0b688672b0c6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.315685 Aug 25 03:08:59.766153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 189/398] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:08:59 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:00.520382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:00.522444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:00.535092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:00.535898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:00.537607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:00.540276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:00.540979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:00.541591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:00.585355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:00.793346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:00.793995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:00.807412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:00.807914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:00.808409 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:00.809096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:00.809616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:00.810044 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:00.945693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:00.969743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-322ea52d-f75a-4cd1-87cb-6fe9a69894a5 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.454427 Aug 25 03:09:00.971795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 210/399] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:00 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:01.068716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:01.082914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:01.087897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:01.090469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-328196c7-f748-4a98-a4c5-45f9cf5cd9f9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.304073 Aug 25 03:09:01.116326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 190/400] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:00 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:02.006507 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:02.015571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:02.023211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:02.023754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:02.024272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:02.025060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:02.025559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:02.026253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:02.174456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:02.176866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:02.186784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:02.187701 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:02.191357 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:02.201929 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:02.204834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:02.209103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:02.447406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:02.459392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a72d6b22-54db-4557-a47a-9483aa0937c9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.465061 Aug 25 03:09:02.461366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 211/401] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:01 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:02.559270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:02.567463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:02.572087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:02.573941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:02.575399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a6a0c441-b9bb-43c4-978e-86227254f530 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.451109 Aug 25 03:09:02.580309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 191/402] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:02 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:03.482170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:03.483562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:03.491824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:03.493216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:03.495396 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:03.496743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:03.497375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:03.497984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:03.604118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:03.604767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:03.625474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:03.626011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:03.636867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:03.638377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:03.648873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:03.649605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:03.894988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:03.913894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f7267aed-7ec9-4f26-b97b-4858743e1135 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.435604 Aug 25 03:09:03.919960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 212/403] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:03 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:03.952110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "name": "network-vif-plugged", "status": "completed", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:03.964560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:03.965330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:03.965979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:03.981699 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] Creating event network-vif-plugged:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:09:03.994982 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:03.999588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-3204decf-9dfc-41fd-b221-9d1c012a7661 req-838d5c6f-1a57-4781-ab35-e1c45b44ba91 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050876 Aug 25 03:09:04.005676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:04.019199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 213/404] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:04.019303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:04.019303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b290a5e8-288b-4818-8a67-2cccd726e88a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.409512 Aug 25 03:09:04.024692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 192/405] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:03 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:04.948748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:04.950155 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:04.957141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:04.958454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:04.959386 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:04.960395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:04.961189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:04.961779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:05.033874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:05.035058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:05.046752 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:05.047244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:05.047682 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:05.053424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:05.053961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:05.055666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:05.157522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:05.171017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5c675382-99a0-4909-9506-e1a496ff478b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.226279 Aug 25 03:09:05.171805 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 214/406] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:04 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:05.279462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:05.289122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:05.291872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:05.293290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-75823711-5ae9-4bc2-8b94-c640a1b87cd2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.263459 Aug 25 03:09:05.294327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 193/407] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:05 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:06.201251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:06.206514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:06.210574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:06.214623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:06.215534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:06.216291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:06.216741 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:06.217165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:06.317030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:06.318625 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:06.330122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:06.334097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:06.334638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:06.335518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:06.336948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:06.337377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:06.500948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:06.506199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-31561023-8e81-431f-81dc-1de1c4dc4607 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1369 microversion: 2.1 time: 0.308929 Aug 25 03:09:06.524466 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 215/408] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:06 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1369 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:06.558426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:06.569350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:06.571941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:06.573133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-90b03e87-61b7-4445-a1b0-68b76abd6265 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.261175 Aug 25 03:09:06.573692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 194/409] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:06 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:07.528791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:07.529639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:07.535679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.538575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.540440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.541523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.547059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.548796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.599999 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:07.600869 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:07.613885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.614953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.618027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.621767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.622420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.623502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.788940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:07.801235 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-968bfc08-cd5e-4606-b441-e24986f73d65 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1563 microversion: 2.1 time: 0.276738 Aug 25 03:09:07.817491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 216/410] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:07 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1563 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:07.832739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:07.834033 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:07.853727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:07.863957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.864799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.865420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:07.866268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.867366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:07.869342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:07.870700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:07.872356 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:07.873562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-42dd3297-e140-4ce5-8996-b6aaf782a2c8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.278682 Aug 25 03:09:07.874123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 195/411] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:07 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:08.060512 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ab62b874-d563-4c1f-b9de-6ee2512a8ebb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214965 Aug 25 03:09:08.060512 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 217/412] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:09:07 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:08.914686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:08.915896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:08.923056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:08.923531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:08.923954 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:08.924693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:08.925156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:08.925629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:09.069963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:09.078956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:09.080853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:09.082177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-36846000-f710-4f06-9cbe-8a6739387190 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.171364 Aug 25 03:09:09.097022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 196/413] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:08 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:09.905630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:09.937460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:09.938178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:09.948922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:09.967333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] Creating event network-changed:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:09:09.974712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-4abd9d4c-b74f-4b41-ab54-35c01d8caaa3 req-d342c493-4922-4215-ae70-7e588295f25c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072630 Aug 25 03:09:09.975539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 218/414] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:10.106825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:10.107484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:10.117900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:10.119424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:10.120786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:10.123499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:10.124213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:10.124807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:10.420308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:10.436846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:10.438756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:10.440688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a8664a03-931b-4355-9222-0e8b88054cb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.338377 Aug 25 03:09:10.453025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 197/415] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:10 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:10.682858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-134377426", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1103826834", "security_groups": [{"name": "tempest-secgroup-smoke-385030089"}], "networks": [{"uuid": "a77f17b6-1817-4296-9c12-5c085b9f2966"}], "block_device_mapping_v2": [{"uuid": "e0b0096e-e115-4d3a-9235-5b255b3edca2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:10.919592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] validate_networks() for [('a77f17b6-1817-4296-9c12-5c085b9f2966', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:09:11.467171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:11.467777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:11.490505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:11.493633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:11.494277 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:11.501155 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:11.501533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:11.502152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:11.598721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:09:11.599388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:09:11.600032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:09:11.600619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:09:11.601257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:09:11.612626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:11.613581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:11.614946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:11.616071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:11.616895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:11.617637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:11.648333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Getting quotas for project 54df2648916c4681af69062a1d5b7430. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:09:11.653912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Getting quotas for user 2927c54860d840538bab1004441c104b and project 54df2648916c4681af69062a1d5b7430. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:09:11.727799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:11.742118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:11.743849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:11.745235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c708fe97-2aaa-48e8-b3cd-4b54f84345ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.282433 Aug 25 03:09:11.746430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 198/416] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:11 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:11.806504 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:09:11.809752 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0b0096e-e115-4d3a-9235-5b255b3edca2',volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:09:12.769743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:12.770355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:12.781023 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:12.781504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:12.781935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:12.782677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:12.783164 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:12.783578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:12.946195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:12.954143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:12.958535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:12.958535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ba6fb010-ce7b-4ac1-9500-e41236309a00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.191496 Aug 25 03:09:12.958535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 199/417] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:12 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:13.101674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cd300684-e483-4f71-ba6e-e6096ed6433a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.425025 Aug 25 03:09:13.111636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 219/418] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:09:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 2436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:09:13.114341 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3ad0fe26-8231-4bb8-92bc-299b8039c143 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:13.115461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3ad0fe26-8231-4bb8-92bc-299b8039c143 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:13.208334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3ad0fe26-8231-4bb8-92bc-299b8039c143 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:13.220794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3ad0fe26-8231-4bb8-92bc-299b8039c143 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1088 microversion: 2.1 time: 0.104987 Aug 25 03:09:13.221346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 200/419] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:13 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1088 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:13.981749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:13.987405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:13.992516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:13.993001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:13.993441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:13.994119 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:13.994607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:13.995138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:14.162336 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:14.179463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:14.184810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:14.184810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b531dfa7-b278-4637-9c9b-79e916a26f97 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.205359 Aug 25 03:09:14.184810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 220/420] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:13 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:14.242071 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8964428b-923a-4d98-9c16-81235abb004e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:14.242716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8964428b-923a-4d98-9c16-81235abb004e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:14.317171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8964428b-923a-4d98-9c16-81235abb004e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:14.324385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8964428b-923a-4d98-9c16-81235abb004e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1088 microversion: 2.1 time: 0.086734 Aug 25 03:09:14.339437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 201/421] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:14 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:15.210261 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:15.210261 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:15.215220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:15.215706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:15.216139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:15.216889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:15.217343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:15.217764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:15.345853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:15.346482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:15.353511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:15.353988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:15.354602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:15.355361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:15.355807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:15.356251 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:15.373703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:15.382967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:15.384604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:15.385838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-eec6faff-25b7-46ee-9d70-4f2e20c3e58d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1738 microversion: 2.20 time: 0.184123 Aug 25 03:09:15.386393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 221/422] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:15 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:15.424437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:15.433827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6647b59a-1d9f-4c20-a60f-f1a4a4f9e19a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1138 microversion: 2.1 time: 0.092229 Aug 25 03:09:15.434437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 202/423] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:15 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:09:16.409736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:16.410402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:16.418876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:16.419357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:16.419789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:16.420633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:16.425232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:16.425232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:16.454869 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:16.457770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:16.463179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:16.463661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:16.464090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:16.464926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:16.465281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:16.465873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:16.536862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:16.546541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9970e72f-3098-446b-86c3-0b29acac79a8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1186 microversion: 2.1 time: 0.095459 Aug 25 03:09:16.548047 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 203/424] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:16 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:09:16.568967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:16.577556 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:16.579193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:16.580382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f5d57280-8362-4dcf-913c-f85c18d563e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1720 microversion: 2.20 time: 0.175205 Aug 25 03:09:16.581063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 222/425] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:16 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:17.571853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:17.572636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:17.578957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:17.579432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:17.579857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:17.580560 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:17.581005 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:17.581421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:17.605511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:17.606125 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:17.612166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:17.612669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:17.613107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:17.614294 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:17.614757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:17.615306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:17.649408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:17.657493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-222d40f5-8567-4229-9df4-6f765782cb57 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1186 microversion: 2.1 time: 0.090400 Aug 25 03:09:17.658349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 204/426] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:17 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:17.762163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:17.770693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:17.772412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:17.773642 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5236aa37-84e2-4cd2-ab42-f765ca5f35c1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1720 microversion: 2.20 time: 0.172133 Aug 25 03:09:17.774309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 223/427] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:17 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:18.681293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:18.682503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:18.689217 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:18.689702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:18.690168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:18.690866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:18.691342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:18.691801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:18.761235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:18.769573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-236fc22e-e8ea-4ea0-87de-0454b95c3a6f tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1186 microversion: 2.1 time: 0.092221 Aug 25 03:09:18.770835 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 205/428] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:18 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:18.796781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:18.797428 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:18.799909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:18.805014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:18.805505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:18.806000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:18.806715 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:18.807166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:18.807583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:18.952302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:18.960947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:18.962433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:18.963573 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bd85ec5f-2722-48bb-8e7c-b01ff256f809 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1723 microversion: 2.20 time: 0.170718 Aug 25 03:09:18.964128 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 224/429] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:18 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:18.994193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c62744d0-614c-4385-b56c-2aee03ad11ef"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:18.996605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:19.002600 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:19.003078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:19.003501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:19.004210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:19.005463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:19.005880 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:19.755251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "name": "network-vif-unplugged", "status": "completed", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:19.767470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:19.767470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:19.767470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:19.780966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.compute.server_external_events [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] Unable to find a host for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6. Dropping event network-vif-unplugged {{(pid=121256) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 03:09:19.781856 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-61c0bfbd-4528-449f-a34f-7afdb934334d req-f0f1be03-984f-4397-a629-0cd26751b538 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031373 Aug 25 03:09:19.782719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 225/430] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 25 03:09:19.791732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:19.792385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:19.798252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:19.798875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:19.799141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:19.799818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:19.800349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:19.800767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:19.881410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:19.889668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-194a8ea8-2912-47a3-bfa6-07e7be551622 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1204 microversion: 2.1 time: 0.101693 Aug 25 03:09:19.895703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 226/431] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:19 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:20.763119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-867a9d07-889f-47f1-bedb-4108735f2676 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.773159 Aug 25 03:09:20.763799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 206/432] 10.222.0.75 () {62 vars in 1364 bytes} [Thu Aug 25 03:09:18 2022] POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 188 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:09:20.892263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:20.893458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:20.901053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:20.901584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:20.902013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:20.902714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:20.903324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:20.903751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:20.920686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:20.941026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:20.944468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=76 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:20.949334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:20.949964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:20.950408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:20.951173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:20.951619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:20.952051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:20.952253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121256) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:09:21.151342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:21.154844 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:21.159469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bd1b1db0-133e-4099-b048-8d8c69f5aff2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1271 microversion: 2.1 time: 0.249561 Aug 25 03:09:21.160028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 207/433] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:20 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1271 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:09:21.351017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:21.365612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:21.366199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:21.367075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:21.378490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] Creating event network-changed:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:09:21.384051 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-33967cbd-2389-449b-ad22-12b579d93892 req-3c53b568-c8c1-41a6-90fd-ef554e20ec95 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039037 Aug 25 03:09:21.385797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 208/434] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:21.491277 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5f86bc3f-2fba-49a5-9950-f5ff353af60a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/action" status: 202 len: 0 microversion: 2.20 time: 0.602652 Aug 25 03:09:21.496609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 227/435] 10.222.0.75 () {62 vars in 1319 bytes} [Thu Aug 25 03:09:20 2022] POST /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:09:21.510668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:21.512065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:21.528008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:21.528008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:21.528008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:21.529403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:21.530364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:21.531329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:21.753612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:21.773041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:21.776065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:21.778350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bae1c3fd-7707-4fc0-8826-1e536b3a62a5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1749 microversion: 2.20 time: 0.276256 Aug 25 03:09:21.779377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 209/436] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:21 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1749 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:22.181696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:22.182328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:22.184328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:22.184922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:22.190182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:22.190657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:22.191190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:22.192874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:22.193458 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:22.193925 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:22.347773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:22.356986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e3cf5476-d60c-41ce-b845-345cba7bc071 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.179227 Aug 25 03:09:22.357562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 228/437] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:22 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:09:22.807639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:22.808359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:22.815367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:22.815846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:22.816312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:22.817335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:22.817866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:22.818290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:22.955131 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:22.964573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:22.966078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:22.967449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ea013d28-8b7b-43ce-9d0a-14066ebd094c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1749 microversion: 2.20 time: 0.163740 Aug 25 03:09:22.967949 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 210/438] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:22 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:23.380461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:23.381183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:23.390500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:23.390936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:23.391264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:23.392021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:23.392583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:23.397620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:23.398676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:23.547107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:23.554736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8bbefe2e-3c38-40c0-913a-e90a83d35bd3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.180129 Aug 25 03:09:23.555303 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 229/439] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:23 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:23.992331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:23.992931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:24.001025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:24.001502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:24.008195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:24.008195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:24.008195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:24.008195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:24.168985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:24.178186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:24.179672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:24.180856 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2b9a19d5-bfad-4d8d-b4bf-d02d699556c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1749 microversion: 2.20 time: 0.193114 Aug 25 03:09:24.181415 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 211/440] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:23 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:24.576136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:24.576772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:24.584588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:24.585069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:24.585504 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:24.586189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:24.586645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:24.587066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:24.750616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:24.759407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-28ba64db-8317-462e-8b86-efe9f4c57bd5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.187136 Aug 25 03:09:24.760231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 230/441] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:24 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:25.205359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:25.206082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:25.208770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:25.214510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:25.214994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:25.215426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:25.216120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:25.216595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:25.217015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:25.368479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:25.378121 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:25.379903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:25.381413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8b2a32a4-b6dd-418c-abda-135f20e10b35 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1749 microversion: 2.20 time: 0.181189 Aug 25 03:09:25.381991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 212/442] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:25 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:25.785665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:25.786281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:25.793043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:25.793518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:25.793948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:25.794633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:25.795074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:25.795490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:25.929177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:25.936969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-647b0af6-5e64-4115-9f7b-4b779547a630 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.155591 Aug 25 03:09:25.937529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 231/443] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:25 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:26.406911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:26.407513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:26.415310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:26.415797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:26.416270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:26.416961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:26.417416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:26.417843 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:26.553743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:26.562683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:26.564110 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:26.565315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-73b7e62b-c52d-4bc1-85d4-3f5aca3a3f98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1751 microversion: 2.20 time: 0.162437 Aug 25 03:09:26.565867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 213/444] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:26 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:26.958843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:26.959446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:26.966323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:26.966784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:26.967214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:26.967904 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:26.968406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:26.968828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:27.316562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:27.325027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2a9c99fa-d72b-4c22-8fe5-ddc6dbd3ee1a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.371265 Aug 25 03:09:27.325591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 232/445] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:26 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:27.591365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:27.592430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:27.602664 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:27.603153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:27.603588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:27.604317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:27.604767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:27.605187 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:27.739334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:27.748969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:27.750683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:27.751871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ca083aa4-bf8f-4422-bf32-bc4715013ebc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.168123 Aug 25 03:09:27.752619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 214/446] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:27 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:28.346469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:28.347135 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:28.354245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:28.354719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:28.355145 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:28.355930 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:28.356405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:28.356823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:28.489041 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:28.496614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2e8c3a5a-97e1-4e56-8c4f-c0d1e4dcc210 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.153853 Aug 25 03:09:28.497176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 233/447] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:28 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:28.775467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:28.784821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:28.784821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:28.784821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:28.784821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:28.785252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:28.785252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:28.785475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:29.001525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:29.011318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:29.012941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:29.014090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6a41ff19-6527-4d41-8a5a-df20ccfa36bb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.242555 Aug 25 03:09:29.014902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 215/448] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:28 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:29.518111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:29.518710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:29.525367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:29.525849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:29.526278 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:29.526960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:29.527403 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:29.527915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:29.669287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:29.677625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-62abf181-ec2a-429a-b090-c624972b2e2b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.163258 Aug 25 03:09:29.678524 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 234/449] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:29 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:30.037526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:30.039043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:30.049414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:30.051011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:30.051775 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:30.052695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:30.053290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:30.053878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:30.210909 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:30.220017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:30.221522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:30.222792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6c9ac7c8-b1ee-4ba4-a9b4-842c28046525 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.189493 Aug 25 03:09:30.223614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 216/450] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:30 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:30.699645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:30.701035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:30.709747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:30.710599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:30.711243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:30.722380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:30.722380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:30.722380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:30.866868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:30.875195 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-74facd5b-40c7-4ac8-b40b-cf7656ce96fc tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.179719 Aug 25 03:09:30.875776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 235/451] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:30 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:31.246157 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:31.246902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:31.253529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:31.254262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:31.254761 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:31.255439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:31.256082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:31.256535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:31.413868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:31.423801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:31.425334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:31.426633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-91aa565b-ee40-487a-b8f6-9a80ada916b1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.184496 Aug 25 03:09:31.427194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 217/452] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:31 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:31.896610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:31.897321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:31.903871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:31.904621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:31.905143 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:31.906085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:31.906466 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:31.906953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:31.909873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "name": "network-vif-plugged", "status": "completed", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:31.920670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:31.921374 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:31.922017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:31.944647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] Creating event network-vif-plugged:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:09:31.950466 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-1f70904a-9dfc-428c-8a39-c56f6113675a req-71b54362-738e-4274-a6d6-4fed12b69573 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044822 Aug 25 03:09:31.954455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 218/453] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:32.084467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:32.094447 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-45378fc9-bd32-4da5-8a47-a02da9f1fdcb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.201806 Aug 25 03:09:32.097629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 236/454] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:31 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:32.453642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:32.454327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:32.460672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:32.461156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:32.461589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:32.462294 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:32.462739 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:32.463343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:32.612213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:32.627707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:32.631128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:32.632381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-dbe12fe4-2633-46b9-82fb-366b164b3e64 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.183406 Aug 25 03:09:32.632944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 219/455] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:32 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:33.122941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:33.123537 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:33.130570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:33.130974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:33.131406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:33.132093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:33.132640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:33.132988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:33.293970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:33.303756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-48f03c42-1007-41c3-98ec-96ad0a9c3193 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.187453 Aug 25 03:09:33.304370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 237/456] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:33 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:33.656955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:33.657891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:33.665888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:33.666623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:33.667233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:33.668234 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:33.668841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:33.669421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:33.820891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:33.824546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:33.825703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:33.826797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f110668e-5ae5-47f1-bff2-5abe2d902723 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.175077 Aug 25 03:09:33.836431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 220/457] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:33 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:34.328056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:34.328798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:34.336574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:34.337015 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:34.337446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:34.338148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:34.338593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:34.339107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:34.492483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:34.501593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-12502578-41de-4813-960f-305b8a9d253e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.179465 Aug 25 03:09:34.512828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 238/458] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:34 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:34.851942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:34.852573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:34.858906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:34.859377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:34.859802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:34.860515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:34.860955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:34.861368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:35.010049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:35.019366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:35.022407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:35.022785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1b72e9f4-d176-40ca-a095-57c7b4f575d8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.175304 Aug 25 03:09:35.023351 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 221/459] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:34 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:35.525460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:35.526095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:35.533059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:35.533540 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:35.533979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:35.534674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:35.535770 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:35.536498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:35.700729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:35.718840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cde61ad3-82c7-4cb2-b14c-1ed22d4f4166 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.197246 Aug 25 03:09:35.721190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 239/460] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:35 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:09:36.048245 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:36.048964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:36.057007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:36.083565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:36.083565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:36.083565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:36.083565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:36.083963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:36.215186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:36.224852 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:36.226351 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:36.227506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1a485ab6-100c-4c29-a301-35b4958d0599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.184187 Aug 25 03:09:36.228409 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 222/461] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:36 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:36.742983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:36.743591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:36.750920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:36.751468 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:36.751856 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:36.752595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:36.753230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:36.753661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:36.906814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:36.915776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5fec4076-3ff1-451c-b5f9-c576a90a5d64 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.177198 Aug 25 03:09:36.916802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 240/462] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:36 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:37.252773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:37.253627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:37.261616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:37.262098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:37.262535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:37.263218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:37.263659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:37.264073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:37.427295 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:37.436518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:37.438025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:37.439177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d366eacd-6d14-452c-9340-32dad19d0843 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.191140 Aug 25 03:09:37.439741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 223/463] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:37 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:37.940664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:37.941357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:37.948785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:37.949266 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:37.949691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:37.950391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:37.950840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:37.951254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:38.100581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:38.108669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4ee721fd-200e-4c8e-86ea-696317f9761d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.171854 Aug 25 03:09:38.109779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 241/464] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:37 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:38.464790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:38.465406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:38.471962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:38.472727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:38.473218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:38.474017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:38.474475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:38.474902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:38.661347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:38.674909 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:38.678115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:38.679312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d30d179e-63a4-487b-ad4c-b924ace90bd9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.218712 Aug 25 03:09:38.679888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 224/465] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:38 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:39.131389 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:39.131998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:39.138376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:39.138855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:39.139286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:39.139975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:39.140449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:39.140873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:39.280185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:39.288222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f17a5929-b27d-4fda-8833-48c8b05b5c45 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.161847 Aug 25 03:09:39.288793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 242/466] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:39 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:39.702962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:39.703638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:39.710236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:39.710711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:39.711138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:39.711821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:39.712297 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:39.712724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:39.842653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:39.846189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:39.852595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:39.860221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:39.860221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8cfe6f77-6439-4a83-bf9e-dd291a72db99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.156302 Aug 25 03:09:39.860221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 225/467] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:39 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:40.309838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:40.310442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:40.317323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:40.317814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:40.318240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:40.319348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:40.319469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:40.319849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:40.452707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:40.461631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ec047a40-486d-4552-899b-b3e3725e5c55 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.155583 Aug 25 03:09:40.462197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 243/468] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:40 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:40.879208 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:40.880187 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:40.887007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:40.887492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:40.887924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:40.888632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:40.889145 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:40.889471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:41.022282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:41.031586 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:41.033444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:41.034740 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4e12efd9-3437-4922-a00c-4e71c33cd1cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.159744 Aug 25 03:09:41.036123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 226/469] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:40 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:41.482833 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:41.483393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:41.490139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:41.498108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:41.498108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:41.498108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:41.498108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:41.498491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:41.629634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:41.638094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d92bc84e-9b3e-40c3-853b-5556261db8e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.159201 Aug 25 03:09:41.647507 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 244/470] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:41 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:42.058662 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:42.059257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:42.065681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:42.067950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:42.067950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:42.067950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:42.067950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:42.068354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:42.204427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:42.213022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:42.218571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:42.218571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-72b5821c-c145-4f7b-86a2-d4156f606dcb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.160924 Aug 25 03:09:42.218571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 227/471] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:42 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:42.658845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:42.659442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:42.666936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:42.667452 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:42.667886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:42.668615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:42.669066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:42.669489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:42.799421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:42.803203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:42.807701 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0472bb19-771c-49b2-b72d-b4724f58e510 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.152768 Aug 25 03:09:42.808295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 245/472] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:42 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:43.239580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:43.240189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:43.251360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:43.251896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:43.252358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:43.253043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:43.253485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:43.254784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:43.384013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:43.392513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:43.393994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:43.395346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f051a138-d532-456c-8a44-3a81e20c6986 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.160279 Aug 25 03:09:43.395908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 228/473] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:43 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:43.829430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:43.830028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:43.837026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:43.837651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:43.838077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:43.838762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:43.839204 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:43.839628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:43.976410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:43.984283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e7b3a41d-e880-435e-9921-a99729749938 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1259 microversion: 2.1 time: 0.159029 Aug 25 03:09:43.985009 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 246/474] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:43 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:44.418204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:44.418886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:44.426650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:44.427183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:44.427619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:44.428350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:44.428855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:44.429274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:44.586824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:44.588840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:44.590563 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:44.591776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2fe5cf97-0831-4747-bde2-e1ca18d3cf51 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.177979 Aug 25 03:09:44.592596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 229/475] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:44 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:45.005366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:45.006134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:45.012591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.013067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.013492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.014176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.014618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.015037 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.147109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:45.152957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-39708298-68ed-4fe6-b1c2-da8bfe4cd886 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1442 microversion: 2.1 time: 0.151698 Aug 25 03:09:45.153529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 247/476] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:44 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:45.174179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:45.174778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:45.181773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.182246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.182676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.183354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.183797 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.184233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.319923 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:45.327687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e34bd554-7950-4b6e-8f0c-0a82fc598b9c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1442 microversion: 2.1 time: 0.157372 Aug 25 03:09:45.328332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 230/477] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:09:45 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:09:45.615071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:45.615745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:45.621801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.622281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.622710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.623391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:45.623837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:45.624282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:45.808688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:45.819183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:45.820916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:45.822297 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-42f494d8-cfec-4548-9bed-1afae565afda tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.211680 Aug 25 03:09:45.823011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 248/478] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:45 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:46.845815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:46.846459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:46.854053 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:46.854538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:46.854973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:46.855667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:46.856119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:46.856561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:47.001401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:47.011430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:47.012953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:47.014085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ea20418b-f461-4fd1-8c45-9c6bf514680e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.172299 Aug 25 03:09:47.014642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 231/479] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:46 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:48.033646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:48.036462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:48.037096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:48.044055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:48.044821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:48.045431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:48.045994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:48.046442 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:48.046560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:48.046935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:48.047083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:48.047491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:48.059148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] Creating event network-changed:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:09:48.065388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-944d1d59-78e4-47b6-a82f-55d2627b5e24 req-8c9037de-2a32-4c9b-8ee7-9704492ef967 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035405 Aug 25 03:09:48.066181 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 249/480] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:09:48.194209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:48.196936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:48.198403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:48.199594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-90902f06-653f-4b0e-93b8-6e934d969378 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.167282 Aug 25 03:09:48.212168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 232/481] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:48 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:49.224875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:49.225716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:49.232453 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:49.232928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:49.233355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:49.234041 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:49.234486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:49.234999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:49.376461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:49.385531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:49.387044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:49.388242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2fabf84d-984f-4d49-b8fd-a2944e70dcce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.168291 Aug 25 03:09:49.388797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 250/482] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:49 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:50.410861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:50.412144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:50.418518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:50.418994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:50.419418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:50.420091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:50.420557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:50.420969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:50.551917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:50.560820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:50.562278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:50.563426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d11548dd-308d-4fa4-9cfd-90bee1fdf216 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.156414 Aug 25 03:09:50.563986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 233/483] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:50 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:51.586474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:51.586991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:51.589465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:51.594111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:51.594592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:51.595020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:51.595703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:51.596170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:51.596605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:51.726239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:51.734736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:51.736233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:51.737371 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-aef79006-a5b6-43a3-9ef2-f32b6c929fba tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.155404 Aug 25 03:09:51.737921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 251/484] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:51 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:52.760669 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:52.761260 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:52.763599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=54 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:52.768307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:52.768776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:52.769197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:52.769870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:52.770318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:52.770734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:52.902540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:52.911021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:52.913310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:52.914689 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c05141cb-8750-4206-9af2-62a1ff604f79 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.157942 Aug 25 03:09:52.915241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 234/485] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:52 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:53.937855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:53.938453 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:53.945545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:53.946016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:53.946446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:53.947184 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:53.947563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:53.947976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:54.083016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:54.092307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:54.093880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:54.095070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d53d1525-0829-4da6-a688-0c9c72fecc74 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.161325 Aug 25 03:09:54.095732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 252/486] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:53 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:55.118841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:55.119443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:55.125895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:55.126377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:55.126813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:55.127508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:55.127953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:55.128400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:55.262868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:55.272026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:55.273625 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:55.274806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-29bc4aba-dbe5-409e-b236-4e6a3ae95dbd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.160672 Aug 25 03:09:55.275362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 235/487] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:55 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:56.298418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:56.299005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:56.306182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:56.306657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:56.307134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:56.307881 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:56.308397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:56.308841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:56.438304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:56.447481 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:56.448996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:56.450140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-56661bb4-1ef8-445a-85ec-37a23c7fa847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.156094 Aug 25 03:09:56.450694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 253/488] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:56 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:57.474057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:57.483304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:57.483304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:57.483304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:57.483304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:57.483684 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:57.483829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:57.484290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:57.602708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e7b2319-1763-47a2-912e-30ef861db124"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:09:57.604902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:57.611290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:57.611799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:57.612262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:57.612961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:57.613438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:57.613875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:57.616636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:57.625967 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:57.627542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:57.629119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-95ec9bfb-c736-4e27-b0c4-58bb681f1751 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.159025 Aug 25 03:09:57.629785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 236/489] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:57 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:09:58.044436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:58.044921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:58.050876 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:58.051407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:58.051835 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:58.052541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:58.053043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:58.053459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:58.180762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lazy-loading 'services' on Instance uuid 832b5cf4-2011-4790-8c89-e4078b8cf262 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:09:58.562343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-60d7e85f-c6fb-4f46-8ff2-a264033c2208 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments/9cff1d21-e38e-4f52-9f1a-7ae7f6c95c9c" status: 202 len: 0 microversion: 2.1 time: 0.521597 Aug 25 03:09:58.562947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 237/490] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:09:58 2022] DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments/9cff1d21-e38e-4f52-9f1a-7ae7f6c95c9c => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:09:58.652578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:58.653257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:58.659368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:58.659844 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:58.660311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:58.660980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:58.661423 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:58.661836 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:58.837005 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:58.846411 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:58.847900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:09:58.849140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-830fe299-3157-4f66-8f93-0c62fb8b401e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.201329 Aug 25 03:09:58.849698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 238/491] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:58 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:09:59.641214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6f71180f-bc14-46d8-817e-9c3244711bfc tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.043052 Aug 25 03:09:59.641822 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 254/492] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:09:57 2022] POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 194 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:09:59.872525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:09:59.873127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:09:59.879938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:59.880636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:59.881071 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:09:59.881755 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:09:59.882195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:09:59.882609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:00.018939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:00.028256 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:00.029756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:00.030893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a1a7efc7-09d4-48b5-b08f-0dc37ed6991c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.163115 Aug 25 03:10:00.031457 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 239/493] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:09:59 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:01.055380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:01.056095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:01.062298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:01.065820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:01.065820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:01.065820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:01.065820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:01.066462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:01.240098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:01.249242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:01.250871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:01.252227 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cf8691c4-38f5-4b27-b33d-e7526cf1ba99 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.201764 Aug 25 03:10:01.255922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 255/494] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:01 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:01.947653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "name": "network-vif-plugged", "status": "completed", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:01.957791 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:01.958268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:01.958716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:01.970152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] Creating event network-vif-plugged:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:10:01.979500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-2b0f0fdf-78ca-4576-842a-9f86b8d17195 req-dbb7266f-5956-43a5-9634-10fb6d1f17a3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031825 Aug 25 03:10:01.980350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 240/495] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:10:02.278349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:02.279004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:02.288796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:02.289333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:02.289902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:02.290484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:02.290936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:02.291390 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:02.439462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:02.449890 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:02.451399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:02.452595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-72289ff2-c0f1-4184-bf14-b8ecda4faf2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.181319 Aug 25 03:10:02.453162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 256/496] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:02 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:03.487620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:03.488346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:03.495473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:03.495955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:03.496427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:03.497119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:03.497561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:03.497987 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:03.636077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:03.644959 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:03.646510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:03.647690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-522ce358-e24c-47c0-9fdd-9734597f4392 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.164543 Aug 25 03:10:03.648272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 241/497] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:03 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:04.671607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:04.672254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:04.688716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:04.689243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:04.689697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:04.690569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:04.691279 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:04.691862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:04.827112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:04.836054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:04.839165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:04.841256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2dd13edf-a710-481d-a118-24b837e59ce0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.173553 Aug 25 03:10:04.841818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 257/498] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:04 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:05.863818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:05.864446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:05.871710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:05.872237 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:05.872699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:05.873412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:05.873881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:05.874629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:05.893870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:06.016066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:06.025484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:06.027032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:06.028282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-77283de4-85e5-41f2-b32a-8789246b3599 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.168403 Aug 25 03:10:06.028840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 242/499] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:05 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:07.050489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:07.051094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:07.057907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:07.058387 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:07.061778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:07.061778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:07.061778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:07.061778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:07.197005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:07.205763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:07.207250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:07.208425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6e83051f-c4e3-4176-b7f7-e06199ed5bee tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.161824 Aug 25 03:10:07.209000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 258/500] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:07 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:08.244762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:08.244762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:08.246981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:08.247667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:08.248258 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:08.249088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:08.249957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:08.250508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:08.434630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:08.434630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:08.435054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:08.435054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-193922c9-c741-4769-ba4b-5f1cbbf068d1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.197442 Aug 25 03:10:08.435054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 243/501] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:08 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:10:09.456229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:09.460250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:09.463752 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:09.464258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:09.464684 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:09.465359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:09.465799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:09.466214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:09.601236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:09.610172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:09.611791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:09.612993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a38b64ed-9f85-4d8a-b27a-9ad9f0882643 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.160767 Aug 25 03:10:09.613549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 259/502] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:09 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:10.638201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:10.638805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:10.646189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:10.646700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:10.647138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:10.647839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:10.648318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:10.648910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:10.785553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:10.794233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:10.795700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:10.796861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2661c49b-76f1-43a4-ac22-5df98fd76ab1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.163881 Aug 25 03:10:10.797416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 244/503] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:10 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:11.819888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:11.820537 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:11.827469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:11.827954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:11.828454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:11.829155 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:11.829608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:11.830037 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:11.970092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:11.979036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:11.980549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:11.981793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-07d74b35-9817-4015-b84c-0162f26b410d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.165814 Aug 25 03:10:11.982382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 260/504] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:11 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:13.074275 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:13.074275 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:13.074275 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:13.074275 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:13.076573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:13.076573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:13.076573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:13.076573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:13.182462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:13.191499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:13.193830 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:13.194951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f83d54d7-9889-401d-8f10-64afaea8bf0a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.193790 Aug 25 03:10:13.198931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 245/505] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:13 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:13.553720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:13.560730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:13.561214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:13.561749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:13.583872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Going to try to stop instance {{(pid=121256) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 25 03:10:13.589096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:13.767874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-972103830", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "networks": [{"uuid": "93f094cc-75b2-48ea-b047-edaab0694da3"}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:13.820440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] validate_networks() for [('93f094cc-75b2-48ea-b047-edaab0694da3', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:10:13.842090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-148fdcc2-21af-4a1d-b8f2-057e444c15b7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action" status: 202 len: 0 microversion: 2.1 time: 0.291575 Aug 25 03:10:13.843415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 261/506] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:10:13 2022] POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:10:13.857562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:13.858568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:13.864912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:13.868792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:13.868792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:13.868792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:13.868792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:13.869208 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:14.006379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:14.012267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5d04eb7e-eaaa-47e9-856f-74b041a26ee2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.162597 Aug 25 03:10:14.012840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 262/507] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:13 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:14.197715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:10:14.198117 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:10:14.198578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:10:14.199001 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:10:14.199404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:10:14.208186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:14.208771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:14.209268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:14.209899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:14.210341 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:14.211203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:14.220255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:14.220868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:14.226697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:14.227736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:14.228384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:14.229030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Getting quotas for project aa73d487b3884350889e14e0b018e0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:10:14.229172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:14.229525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:14.229926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:14.233062 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Getting quotas for user be1baf177c664022ac3e872df3a3cd27 and project aa73d487b3884350889e14e0b018e0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:10:14.245050 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:10:14.247695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:10:14.367073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:14.376389 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:14.377956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:14.379363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a4ea9cfa-0d2e-425c-b69a-6f3ba3bb1187 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.163201 Aug 25 03:10:14.379972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 263/508] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:14 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:14.427700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fa066a8c-3645-4798-a17d-27df69165983 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663733 Aug 25 03:10:14.428447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 246/509] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:10:14.439776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e0c31d33-4fc1-4e32-a799-4492674aab6b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:14.440497 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e0c31d33-4fc1-4e32-a799-4492674aab6b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:14.498375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e0c31d33-4fc1-4e32-a799-4492674aab6b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:14.505468 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e0c31d33-4fc1-4e32-a799-4492674aab6b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1218 microversion: 2.1 time: 0.069546 Aug 25 03:10:14.506038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 264/510] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:14 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:15.034298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:15.034897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:15.042068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:15.042550 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:15.042974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:15.043651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:15.044098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:15.044558 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:15.174375 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:15.182510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7131ca81-6437-45d1-8c4a-b167d8bc7aac tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.152198 Aug 25 03:10:15.183148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 247/511] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:15 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:15.403288 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:15.404103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:15.412763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:15.413567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:15.414077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:15.415470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:15.416192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:15.416617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:15.527215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f303e494-bb7f-4f0e-937f-2bd262a01072 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:15.534005 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f303e494-bb7f-4f0e-937f-2bd262a01072 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:15.566663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:15.576716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:15.578264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:15.579428 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5216f72e-6b34-48d5-84a8-3c3744e6706c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.180949 Aug 25 03:10:15.580193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 265/512] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:15 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:15.610633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f303e494-bb7f-4f0e-937f-2bd262a01072 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:15.619634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f303e494-bb7f-4f0e-937f-2bd262a01072 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1218 microversion: 2.1 time: 0.096863 Aug 25 03:10:15.620444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 248/513] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:15 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:16.203840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:16.204514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:16.210325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.210725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.211837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.212789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.213234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.213655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.409176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:16.417571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a9958e33-7ffc-4bbb-90b4-801e7ce5cccc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.217551 Aug 25 03:10:16.419983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 266/514] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:16 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:16.603692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:16.604496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:16.614479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.619984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.620462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.621178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.621807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.622226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.641978 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:16.642589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:16.652131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.652657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.653089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.653776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:16.660712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:16.661144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:16.735525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:16.743669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f9ddc017-f813-456e-a3ed-5e090bde9be7 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1270 microversion: 2.1 time: 0.107329 Aug 25 03:10:16.744290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 267/515] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:16 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:16.806568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:16.813921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:16.815486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:16.816696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-51240096-fdac-4d11-a2cc-fa76e7758d54 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1807 microversion: 2.20 time: 0.218512 Aug 25 03:10:16.817281 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 249/516] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:16 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1807 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:10:17.438946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:17.439522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:17.446941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.447516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.447906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.448627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.449074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.449490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.587967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:17.597737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a49575b6-054f-4b0b-be08-2c1e33ae8ee3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.162534 Aug 25 03:10:17.598661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 268/517] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:17 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:17.765757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:17.766948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:17.773360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.773995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.781960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.781960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.781960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.781960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.839175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:17.839687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:17.845996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.846249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:17.846474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.847100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.847792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:17.848262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:17.849029 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:17.854715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-df4b4838-7f04-47e6-b927-919f20e0387d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1276 microversion: 2.1 time: 0.092877 Aug 25 03:10:17.865773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 250/518] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:17 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:17.997496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:18.006910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:18.008959 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:18.010124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-363ed5ef-cb04-4ee7-852f-3055256e80e5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1794 microversion: 2.20 time: 0.175118 Aug 25 03:10:18.010680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 269/519] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:10:17 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:10:18.620097 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:18.620746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:18.627121 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:18.627656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:18.628449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:18.629144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:18.629627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:18.630045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:18.840035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:18.847667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-558b53ce-cbf5-4e41-9839-ddf4d166f551 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.231999 Aug 25 03:10:18.848255 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 251/520] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:18 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:18.878373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:18.878975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:18.885399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:18.885874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:18.886310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:18.886988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:18.887431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:18.887847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:18.997882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3eb59da-443d-4d19-842b-972b947331ca", "tag": "9f731190-6dbd-4181-af3f-32c35bb92186"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:19.008541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:19.009169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:19.013989 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:19.021514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] Creating event network-changed:9f731190-6dbd-4181-af3f-32c35bb92186 for instance c3eb59da-443d-4d19-842b-972b947331ca on hv-cinder-77957 Aug 25 03:10:19.027082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-9943137e-dfc7-4d0b-b58c-2dce94586a45 req-72ed7d22-0c3f-41d5-a44b-9654721c5b48 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032699 Aug 25 03:10:19.027681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 252/521] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:10:19.030876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:19.039444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9377dbf6-8bc4-4141-b75a-19362af2ddc5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.165008 Aug 25 03:10:19.040276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 270/522] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:18 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:19.870607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:19.871311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:19.877417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:19.878139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:19.878568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:19.879264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:19.879703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:19.880118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:20.056096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:20.060468 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:20.061159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:20.064302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-12d76861-90e6-4c89-b76c-02ce9a8395bc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.198650 Aug 25 03:10:20.064879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 253/523] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:19 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:20.067634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:20.068180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:20.068633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:20.069496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:20.069958 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:20.070383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:20.205267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:20.213703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d1d91746-bbf5-40f6-894f-ae0652c0e6d3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.157264 Aug 25 03:10:20.214266 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 271/524] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:20 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:21.085848 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:21.087203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:21.093571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:21.094043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:21.094470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:21.095173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:21.095614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:21.096024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:21.226583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:21.233982 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:21.234593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:21.234863 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1804ec22-3cae-4286-be71-b640133f9c98 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.152802 Aug 25 03:10:21.235446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 254/525] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:21 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:21.241027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:21.241509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:21.241943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:21.243137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:21.243580 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:21.243998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:21.375969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:21.384419 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7d482961-438f-409f-ba4f-7091855581cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.154230 Aug 25 03:10:21.384972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 272/526] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:21 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:22.205617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:22.207850 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:22.214447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.214921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.215346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.216038 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.216550 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.216968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.239377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'flavor' on Instance uuid e2617bf5-70b8-4eb3-81ee-563d8d7e57ae {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:10:22.257043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:22.257743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:22.261183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=46 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:22.266095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.266588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.267123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.267871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.268346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.272569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.403409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:22.411297 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1fdbf075-5a0f-4457-8d3d-cbf193a21513 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.158427 Aug 25 03:10:22.411858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 273/527] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:22 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:22.417081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:22.417678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:22.423329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.423780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.424226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.424903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.425349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.425765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.562477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:22.570226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-12736de4-14d6-4573-b677-c5780b66f29a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.157389 Aug 25 03:10:22.570835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 274/528] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:22 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:22.646355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b181587e-5138-42e2-8565-bc7dd769e0ed tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/action" status: 200 len: 32 microversion: 2.1 time: 0.444949 Aug 25 03:10:22.647066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 255/529] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:10:22 2022] POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:10:22.657815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:22.658453 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:22.664341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.665066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.665675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.666372 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:22.666823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:22.667245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:22.798567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:22.807817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d678ca84-3fa6-4444-a16d-d5f90789824a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.153960 Aug 25 03:10:22.808743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 275/530] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:22 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:23.434461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:23.435069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:23.437747 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:23.442571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.443044 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.443476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.444221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.444670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.445087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.591749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:23.592485 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:23.598927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.599409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.599843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.600557 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.601032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.601435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.629085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:23.636995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-213109e2-ed9f-4195-be19-3d6fb18da909 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.207301 Aug 25 03:10:23.637973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 256/531] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:23 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:23.736026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:23.743853 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-11b57477-335a-4d78-a68a-3dea161b8358 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.156055 Aug 25 03:10:23.744483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 276/532] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:23 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:23.829382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:23.829973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:23.835805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.837055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.837569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.838265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:23.838830 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:23.839122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:23.981429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:23.989862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fcb3d2a2-2f25-4001-95ba-d0efdbd01670 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.164228 Aug 25 03:10:23.990426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 257/533] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:23 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:24.170294 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3eb59da-443d-4d19-842b-972b947331ca", "name": "network-vif-plugged", "status": "completed", "tag": "9f731190-6dbd-4181-af3f-32c35bb92186"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:24.179694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.180882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.181302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.191897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] Creating event network-vif-plugged:9f731190-6dbd-4181-af3f-32c35bb92186 for instance c3eb59da-443d-4d19-842b-972b947331ca on hv-cinder-77957 Aug 25 03:10:24.197431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-6d8d5dc0-1328-4d17-bfec-299951a68afd req-b54d41d3-f992-409e-ac7b-6904db66a415 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030848 Aug 25 03:10:24.198080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 277/534] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:10:24.658941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:24.663513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:24.663513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:24.668152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.668649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.669212 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.669912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.670393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.670820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.762442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:24.767231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:24.767928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:24.774088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.774569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.775000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.775689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:24.776138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:24.776584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:24.807525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:24.815418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-70ac5cb6-e8a9-41cc-9eee-d319ba8219b6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1676 microversion: 2.1 time: 0.160495 Aug 25 03:10:24.815993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 258/535] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:24 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:24.911671 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:24.919787 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-02f4b54f-e3b5-4640-b4fc-540268cc2e97 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.158227 Aug 25 03:10:24.924012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 278/536] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:24 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:25.010767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:25.011299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:25.017346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.017820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.018248 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.018920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.019363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.019777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.038110 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:25.149613 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:25.157796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-405c1da2-aa63-4033-8f26-6be9f26832c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.150907 Aug 25 03:10:25.158367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 259/537] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:25 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:25.841791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:25.842327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:25.848818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.849302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.849736 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.850421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.850876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.851296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.855414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:25.940924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:25.941523 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:25.944656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=8 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:25.952770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.952770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.952770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.952770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:25.953176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:25.953176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:25.993494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:26.001204 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-70f6750e-507f-42f4-98f7-306bca72ef08 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1653 microversion: 2.1 time: 0.163349 Aug 25 03:10:26.001779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 279/538] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:25 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:26.027169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:26.033660 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:26.034148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:26.034585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:26.059523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Going to try to start instance {{(pid=121256) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 25 03:10:26.088079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:26.100758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cd744ebf-74d2-4355-b016-40b54fe6da76 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1318 microversion: 2.1 time: 0.158567 Aug 25 03:10:26.100758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 260/539] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:25 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:26.178666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:26.179265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:26.186529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:26.187008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:26.187439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:26.188125 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:26.188592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:26.189012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:26.321340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:26.329613 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6161406a-30aa-4fac-b921-92fb65fafabb tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.154696 Aug 25 03:10:26.330186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 261/540] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:26 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:26.331163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-50d2877b-a030-4f23-b9c3-187e18f9d5a5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action" status: 202 len: 0 microversion: 2.1 time: 0.308009 Aug 25 03:10:26.331816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 280/541] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:10:26 2022] POST /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:10:26.352616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:26.353607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:26.359642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:26.360122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:26.360583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:26.361261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:26.361709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:26.362128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:26.497228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:26.505316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-387c57e7-c6e5-4681-8d5a-6fba62bcf221 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1662 microversion: 2.1 time: 0.157159 Aug 25 03:10:26.505872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 262/542] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:26 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:27.117121 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:27.117831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:27.124139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.124645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.125073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.125843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.126275 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.126705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.265761 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:27.274626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b51d4ff3-11e1-4960-a958-6449960213db tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1506 microversion: 2.1 time: 0.161737 Aug 25 03:10:27.275223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 281/543] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:27 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:27.351163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:27.353635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:27.361137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.361689 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.362119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.362842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.363291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.363737 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.509070 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:27.517596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-68edffec-5e08-49d1-b105-c8b6cbdb7119 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.170068 Aug 25 03:10:27.518161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 263/544] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:27 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:27.528767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:27.529374 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:27.538410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.538896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.540017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.540797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:27.541247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:27.541693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:27.674108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:27.681840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fcbc791b-f4e6-48d0-97cd-fe01c4890fcf tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1662 microversion: 2.1 time: 0.157144 Aug 25 03:10:27.682435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 282/545] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:27 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:28.543474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:28.544077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:28.550681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:28.551176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:28.551588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:28.552304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:28.552756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:28.553181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:28.687385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:28.695620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a9c2fd53-c42c-4f38-8eee-bae44b4e88b4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.157796 Aug 25 03:10:28.696232 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 264/546] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:28 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:28.703590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:28.704211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:28.710573 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:28.711554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:28.711983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:28.712727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:28.713171 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:28.713608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:28.846118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:28.854780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b1f2e567-cb4e-4c94-8ab2-2b0ca65e7630 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1666 microversion: 2.1 time: 0.155115 Aug 25 03:10:28.855354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 283/547] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:28 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:29.717601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:29.718197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:29.725008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:29.725501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:29.725958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:29.726657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:29.727103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:29.727528 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:29.859571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:29.868670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7b3b0728-ce47-4586-99ad-cd98de8c8109 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.155073 Aug 25 03:10:29.869240 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 265/548] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:29 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:30.890433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:30.891044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:30.897522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:30.898003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:30.898877 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:30.899677 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:30.900131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:30.900577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:31.035871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:31.047331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-026b442e-9a6f-4088-92ca-74bc3e632b77 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.160698 Aug 25 03:10:31.047912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 284/549] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:30 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:32.070082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:32.071285 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:32.077714 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:32.078201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:32.078635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:32.079325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:32.079796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:32.080216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:32.216779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:32.225462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cddd1422-d777-4f63-b04c-e5ba95a022ef tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.159155 Aug 25 03:10:32.226033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 266/550] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:32 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:33.250350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:33.251003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:33.258587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:33.259070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:33.259512 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:33.260258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:33.260713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:33.261140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:33.394446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:33.403296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-84bc3cf1-a87e-4077-ac95-a9ce05250ed8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.156872 Aug 25 03:10:33.403860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 285/551] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:33 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:34.424004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:34.424604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:34.431518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:34.431960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:34.432412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:34.433088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:34.433535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:34.433950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:34.564159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:34.572478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-af8fd588-bb71-40de-8ec0-6bbee278d468 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.152463 Aug 25 03:10:34.576193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 267/552] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:34 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:35.594413 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:35.595054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:35.602490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:35.602976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:35.603409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:35.604121 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:35.604592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:35.605038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:35.739879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:35.749378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7270de08-3547-4a28-a68f-7151b7ce23c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.159135 Aug 25 03:10:35.749940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 286/553] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:35 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:36.771503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:36.772124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:36.779134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:36.779607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:36.780032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:36.780735 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:36.781201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:36.781612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:36.918087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:36.926597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4d686ac2-6a75-43f9-b1bd-e55e7352b21f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.158895 Aug 25 03:10:36.927368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 268/554] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:36 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:37.948352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:37.948954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:37.955575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:37.956049 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:37.956552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:37.957248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:37.957702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:37.958126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:38.097265 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:38.106427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-43c7c614-2b2d-4ed4-85e7-78e76be770c8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.162082 Aug 25 03:10:38.106991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 287/555] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:37 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:39.128720 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:39.129319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:39.136377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:39.136856 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:39.137285 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:39.137969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:39.138419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:39.138839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:39.277459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:39.285520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-02e810bc-4a09-4ef2-8f4a-c7c630fe8cac tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.160945 Aug 25 03:10:39.286091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 269/556] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:39 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:40.306676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:40.307334 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:40.313936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:40.314416 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:40.314852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:40.315656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:40.316107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:40.317365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:40.451285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:40.459635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bf8e1900-ab0c-4227-a843-da57c1741617 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.157648 Aug 25 03:10:40.460219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 288/557] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:40 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:41.481842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:41.482443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:41.489222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:41.489713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:41.490154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:41.490902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:41.491384 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:41.491810 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:41.619703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:41.628263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d9e5d461-f286-4a5a-9765-db6438b267f4 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.150284 Aug 25 03:10:41.628845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 270/558] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:41 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:42.650482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:42.651060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:42.657488 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:42.657965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:42.658394 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:42.659078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:42.659526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:42.659948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:42.795815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:42.804024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-42c45c30-124a-4848-8ade-3cbd0faff7ce tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.158119 Aug 25 03:10:42.804614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 289/559] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:42 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:43.824661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:43.825301 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:43.831669 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:43.832158 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:43.832603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:43.833280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:43.833726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:43.834143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:43.971671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:43.980236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-edf2a09b-167f-499b-a37a-ca6a017c8b10 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.160116 Aug 25 03:10:43.980805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 271/560] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:43 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:44.909974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8633878-6c33-4dea-86ba-b1db2d215db2", "device": "/dev/sdb"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:44.913095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:44.920487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:44.920987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:44.921738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:44.922091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:44.922535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:44.922950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:45.003319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:45.003948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:45.011321 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:45.011844 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:45.012343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:45.013081 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:45.013533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:45.013954 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:45.142697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:45.151802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c8e37907-166a-48fb-a66a-43c0f8edd75c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.153383 Aug 25 03:10:45.152412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 272/561] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:44 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:45.777757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2ad2f54d-d169-44b1-be65-a0754fe4832f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "POST /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871582 Aug 25 03:10:45.778549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 290/562] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:10:44 2022] POST /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:10:46.173549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:46.174150 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:46.180501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:46.180970 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:46.181396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:46.182072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:46.182515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:46.182928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:46.319050 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:46.327938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f5b25bbc-cd7c-4c75-a2cd-dea879c4e7a7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.158242 Aug 25 03:10:46.328535 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 273/563] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:46 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:47.350773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:47.352340 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:47.358469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:47.358940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:47.359369 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:47.360044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:47.360515 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:47.360928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:47.491318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:47.500702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-be19f039-7a9d-4858-823d-50fb83ccec37 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.154576 Aug 25 03:10:47.501267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 291/564] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:47 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:48.522649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:48.524087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:48.530521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:48.530994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:48.531422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:48.532091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:48.532581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:48.532995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:48.661583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:48.670365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5e758727-5c2f-41c2-a66e-e48d806e5a07 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.151590 Aug 25 03:10:48.670935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 274/565] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:48 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:49.692673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:49.693283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:49.700509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:49.700993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:49.701424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:49.702112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:49.702560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:49.702988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:49.833640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:49.841915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-780d0695-6072-4c06-9009-0b709a8fa62a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.153110 Aug 25 03:10:49.842471 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 292/566] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:49 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:50.862885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:50.863518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:50.870737 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:50.871215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:50.871650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:50.872360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:50.872811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:50.873232 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:51.005451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:51.014273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d3ec9193-e1ab-41ed-9160-ee1365eb7615 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.155272 Aug 25 03:10:51.014839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 275/567] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:50 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:52.036215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:52.036822 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:52.043433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:52.043916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:52.044384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:52.045072 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:52.045524 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:52.045951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:52.067578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:52.181180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:52.189997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-acb4dda0-1ec5-4e29-aa52-82c6ecaf262d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1732 microversion: 2.1 time: 0.157737 Aug 25 03:10:52.190577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 293/568] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:52 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:53.212519 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:53.213069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:53.219512 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.219997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.231601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.231601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.231601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.231601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.232024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=100 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:53.358887 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:53.367992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-90f0d5d6-3f45-40d5-ab1f-8a96dbb83700 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1712 microversion: 2.1 time: 0.159557 Aug 25 03:10:53.368583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 276/569] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:53 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:53.474688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:53.475176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:53.478247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=42 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:53.482919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.483398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.483832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.484545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.484997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.485442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.611703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] HTTP exception thrown: Cannot 'detach_volume' instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae while it is in vm_state rescued Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Request method failure captured: Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments/6e7b2319-1763-47a2-912e-30ef861db124 HTTP/1.1 Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBucpU8RUMeS449pGN11FAVpH-9_b7FTynxGl66lliI6ZBAMCljHcZQW0qCHHttc93uqHuQRCgwvBiNil4ZTvoLjysM1QcES1CegEVnIK99jTYnhO52FsK5I-7afZxLIDszMyOWy8uuDquZI2kypGG0btXlRozOu9UC2pcKGeVUeILMQ Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:10:53.613342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d5a66dfea4c5492da1ac3e1f76cbe35d"}]}] Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 7daac509316048ec903a5d78d3586aad Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:10:53.614875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Cannot 'detach_volume' instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae while it is in vm_state rescued Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'server_id': 'e2617bf5-70b8-4eb3-81ee-563d8d7e57ae', 'id': '6e7b2319-1763-47a2-912e-30ef861db124'} Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:10:53.615644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae while it is in vm_state rescued Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae while it is in vm_state rescued Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:10:53.618173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Returning 409 to user: Cannot 'detach_volume' instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae while it is in vm_state rescued {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:10:53.619325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-58734c49-f630-47b8-a721-fb9c337c618e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments/6e7b2319-1763-47a2-912e-30ef861db124" status: 409 len: 152 microversion: 2.1 time: 0.144107 Aug 25 03:10:53.619325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 294/570] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:10:53 2022] DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments/6e7b2319-1763-47a2-912e-30ef861db124 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 25 03:10:53.624749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:10:53.625276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:53.627068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=42 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:53.632653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.632835 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.633263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.633936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.634378 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.634912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.954119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-46e82562-54e1-44b2-bd23-e76e21ec3519 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/action" status: 202 len: 0 microversion: 2.1 time: 0.333021 Aug 25 03:10:53.956490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 277/571] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:10:53 2022] POST /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:10:53.963110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:53.963975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:53.971209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.971952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.972431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:53.973136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:53.973593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:53.974023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:54.106097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:54.115616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d3dcf28f-fb1d-4e18-b506-b197456bb250 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1720 microversion: 2.1 time: 0.156288 Aug 25 03:10:54.116271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 295/572] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:53 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:10:55.140214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:55.140905 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:55.147033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:55.147546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:55.148806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:55.149590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:55.150040 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:55.150461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:55.291490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:55.299746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7f3c853b-f25b-4634-bd12-311f4bb98bae tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1720 microversion: 2.1 time: 0.164231 Aug 25 03:10:55.300338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 278/573] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:55 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:56.321320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:56.321842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:56.328414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:56.328919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:56.329356 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:56.330067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:56.330518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:56.330941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:56.458230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:56.466737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c5e9b397-8d29-49ef-ab8d-4b2a5f378ce9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1720 microversion: 2.1 time: 0.149687 Aug 25 03:10:56.467296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 296/574] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:56 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:57.489229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:57.489827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:57.496098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:57.496606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:57.501776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:57.501776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:57.501776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:57.501776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:57.626147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:57.635159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9b7c81fb-77c2-4277-8cf3-ff514eb7549a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1720 microversion: 2.1 time: 0.149840 Aug 25 03:10:57.635715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 279/575] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:57 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:58.655728 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:58.656354 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:58.662847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:58.663327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:58.663751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:58.664461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:58.664907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:58.665322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:58.791597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:58.799643 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bac65182-7242-43b1-af97-6fb037b10fc2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1720 microversion: 2.1 time: 0.147737 Aug 25 03:10:58.800215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 297/576] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:58 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:59.822670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:59.823188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:59.829758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:59.830240 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:59.830669 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:59.831353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:59.831798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:59.832242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:59.897412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:59.898262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:10:59.904841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:59.905327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:59.905757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:59.906479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:10:59.906926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:10:59.907347 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:10:59.938696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b9afbda9-5bef-4471-a0bb-085de1ab786d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments/c62744d0-614c-4385-b56c-2aee03ad11ef" status: 200 len: 194 microversion: 2.20 time: 0.045296 Aug 25 03:10:59.940131 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 298/577] 10.222.0.75 () {60 vars in 1454 bytes} [Thu Aug 25 03:10:59 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments/c62744d0-614c-4385-b56c-2aee03ad11ef => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 25 03:10:59.967661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:10:59.976313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e37bfe24-5795-440d-8291-52d69fa1fd6e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1726 microversion: 2.1 time: 0.158019 Aug 25 03:10:59.977265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 280/578] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:10:59 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:10:59.998580 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:10:59.999069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:00.008825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.008825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.008825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.008825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.009284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.009284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.009627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:00.010118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:00.015951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.016531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.016958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.017636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.018077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.018490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.090364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-454dd4a3-26c4-47cd-afa9-130c75c5b3f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095698 Aug 25 03:11:00.090951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 299/579] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:10:59 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:00.102713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lazy-loading 'services' on Instance uuid 650fe7f9-3642-4118-9da6-e217c1d9d1e6 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:11:00.310139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4b11b955-6755-4702-9634-e6b63972865d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments/c62744d0-614c-4385-b56c-2aee03ad11ef" status: 202 len: 0 microversion: 2.20 time: 0.304698 Aug 25 03:11:00.310732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 281/580] 10.222.0.75 () {60 vars in 1457 bytes} [Thu Aug 25 03:11:00 2022] DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments/c62744d0-614c-4385-b56c-2aee03ad11ef => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:11:00.319202 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:00.321472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:00.327640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.328109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.328571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.329262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:00.329717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:00.330138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:00.361501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4a3dfce9-0730-42d6-aa11-89fa54d8ec17 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046295 Aug 25 03:11:00.362063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 300/581] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:11:00 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:01.036232 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:01.047941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:01.048719 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:01.049163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:01.060711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] Creating event network-changed:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:11:01.067258 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-fba2f553-8c3b-4bd3-9477-231023cd96f9 req-e5dbfb83-e911-4e61-a8e2-a8327861f5f8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035046 Aug 25 03:11:01.067861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 282/582] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:11:01.375292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:01.377828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:01.385342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:01.385822 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:01.386247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:01.386946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:01.387450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:01.387870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:01.420453 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1dcea74c-1df9-4eb1-bf1b-b039bfb902b7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049179 Aug 25 03:11:01.421049 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 301/583] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:11:01 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:02.434650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:02.436891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:02.442900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:02.443368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:02.443794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:02.444595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:02.445150 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:02.445569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:02.476236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c84dc62c-6b1b-4b3f-9c5f-5bfa7c2e9144 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046572 Aug 25 03:11:02.477079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 283/584] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:11:02 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:03.081944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:03.092566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:03.093624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:03.093624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:03.106954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] Creating event network-changed:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:11:03.112166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-6ff987f2-cef7-4e0c-b972-b4da3266c583 req-d3506a3c-d03a-4b3b-a927-9903aa31cbaa service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033652 Aug 25 03:11:03.112695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 302/585] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:03.489851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:03.492933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:03.499336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:03.499818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:03.500278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:03.500975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:03.501424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:03.501843 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:03.535318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-025d635c-4b1d-4f1a-9973-b850678a1e0e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050025 Aug 25 03:11:03.540508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 284/586] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:11:03 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:04.550465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:04.552604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:04.559982 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.560608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.561038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:04.561722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.562166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.562581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:04.590781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d62ada74-9054-4fc5-b35e-80270b3873cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044807 Aug 25 03:11:04.591369 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 303/587] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:11:04 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:04.652766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:04.653290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:04.659562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.660034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.660501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:04.661179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.661620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.662029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:04.687712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:11:04.962912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0bfe5c05-cf17-445c-be3c-599cb2e8a7a1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 204 len: 0 microversion: 2.20 time: 0.313604 Aug 25 03:11:04.963541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 285/588] 10.222.0.75 () {60 vars in 1280 bytes} [Thu Aug 25 03:11:04 2022] DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 03:11:04.971830 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:04.973791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:04.978974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.979444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.979870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:04.980575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:04.981018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:04.981435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:05.266864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:05.275676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:05.277241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:05.284485 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2cc80148-15e4-43ab-b24f-c47a6cf155e3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.310526 Aug 25 03:11:05.284485 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 304/589] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:04 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:06.302359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:06.302988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:06.309821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:06.310289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:06.310712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:06.311387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:06.311824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:06.312277 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:06.506089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:06.514823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:06.516343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:06.517479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ec2989ce-590a-458b-8d4a-70ca3c6c3a98 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.219531 Aug 25 03:11:06.518043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 286/590] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:06 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:07.541216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:07.541808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:07.548278 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:07.548756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:07.554673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:07.554673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:07.554673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:07.554673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:07.684465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:07.692523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:07.694030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:07.695197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-382faa02-3c7a-4273-8193-3816abd55352 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.158498 Aug 25 03:11:07.695750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 305/591] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:07 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:08.719148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:08.719742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:08.727064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:08.727570 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:08.727996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:08.728733 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:08.729184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:08.729597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:08.858986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:08.867559 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:08.869089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:08.870221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fd95709e-a222-4119-af4d-4593baac4d1e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1722 microversion: 2.20 time: 0.155567 Aug 25 03:11:08.870779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 287/592] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:08 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:09.895140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:09.896038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:09.903526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:09.904014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:09.904597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:09.905363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:09.905813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:09.906231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:09.987796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:09.994906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:09.996442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:09.997635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cd45c5bc-ab64-4264-a64f-e2b26a4225ec tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 200 len: 1654 microversion: 2.20 time: 0.107276 Aug 25 03:11:09.998193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 306/593] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:09 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 1654 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:10.202099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650fe7f9-3642-4118-9da6-e217c1d9d1e6", "name": "network-vif-deleted", "tag": "fbdece03-b15e-470f-93bf-0ec38b8bf2e1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:10.214169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:10.214912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:10.215315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:10.228038 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] Creating event network-vif-deleted:fbdece03-b15e-470f-93bf-0ec38b8bf2e1 for instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 on hv-cinder-77957 Aug 25 03:11:10.233394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-be825859-dcfc-4c95-96d1-d1c5fc42f8ad req-db906aa5-d0e7-4953-8ba2-b92414bcbdb4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039933 Aug 25 03:11:10.234220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 288/594] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:11:11.021979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:11.022658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:11.030300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:11.030821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:11.031280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:11.031967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:11.032465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:11.032893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:11.048675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 HTTP/1.1 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:11:11.048810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:11:11.050436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '650fe7f9-3642-4118-9da6-e217c1d9d1e6'} Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:11:11.055972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:11:11.058588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:11.061089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:11:11.061089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e61897be-ccb0-485d-9d20-57d52ae0fc1f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 404 len: 111 microversion: 2.20 time: 0.032372 Aug 25 03:11:11.061089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 307/595] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:11 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:11:11.061588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-72b5b451-d0ea-4cac-bdde-d0aa8b3fe810 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '.version_select at 0x7ff193affd30>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:11.167697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-72b5b451-d0ea-4cac-bdde-d0aa8b3fe810 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22582877" status: 204 len: 0 microversion: 2.20 time: 0.111066 Aug 25 03:11:11.168346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 289/596] 10.222.0.75 () {60 vars in 1256 bytes} [Thu Aug 25 03:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22582877 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 25 03:11:11.732268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:11.733034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:11.739290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:11.739784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:11.740248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:11.741084 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:11.741538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:11.742154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:11.837043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lazy-loading 'services' on Instance uuid c3eb59da-443d-4d19-842b-972b947331ca {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:11:12.096080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3c8eee63-d805-4e25-b8fe-759a69b5de00 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca/os-volume_attachments/b8633878-6c33-4dea-86ba-b1db2d215db2" status: 202 len: 0 microversion: 2.1 time: 0.367178 Aug 25 03:11:12.098551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 308/597] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:11:11 2022] DELETE /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca/os-volume_attachments/b8633878-6c33-4dea-86ba-b1db2d215db2 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:11:12.338825 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-71862163-01ce-43f8-8bb6-2e689723c312 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: .version_select at 0x7ff193bbd5e0>, body: {"keypair": {"name": "tempest-keypair-2093134122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF7xs9S8omzW6u0flOz/SWzOtvgH88nUagrQKE8eWfkGahANj9Bv26h5qkTWaEyAg6mmrmEpNpdmlVbV1eK+SFvsalQ0gZFKtPtpmtVGzYN1tMGLC+MsFd28GuzZwIpLA=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:12.354404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-71862163-01ce-43f8-8bb6-2e689723c312 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:11:12.358126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-71862163-01ce-43f8-8bb6-2e689723c312 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for user fe93db6503a143ab9ed50fedbc8f010f and project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:11:12.431563 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-71862163-01ce-43f8-8bb6-2e689723c312 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.203905 Aug 25 03:11:12.432186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 290/598] 10.222.0.75 () {62 vars in 1200 bytes} [Thu Aug 25 03:11:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 25 03:11:13.242854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:13.242854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:13.242854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:13.242854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:13.244310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:13.245045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:13.245505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:13.245936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:13.271030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:11:13.435314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:13.621312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1792ec97-626c-4ca5-bbc0-b92b20afd391 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 204 len: 0 microversion: 2.1 time: 0.389621 Aug 25 03:11:13.622062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 309/599] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:11:13 2022] DELETE /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:11:13.631287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:13.632276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:13.638600 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:13.639084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:13.639522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:13.640259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:13.640704 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:13.641123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:13.837505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:13.845821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ab675305-d02c-4a68-90b5-f4fb87bab28f tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1512 microversion: 2.1 time: 0.219276 Aug 25 03:11:13.846395 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 291/600] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:13 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:14.869376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:14.871841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:14.872884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:11:14.873034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:11:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca (ip 10.222.0.75) !!! Aug 25 03:11:14.885626 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:14.886109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:14.886534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:14.887396 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:14.887847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:14.888349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:14.945507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1188811449", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ac69087-e8de-47de-ba66-364375da66dd"}], "security_groups": [{"name": "tempest-securitygroup--1954330036"}], "key_name": "tempest-keypair-2093134122", "user_data": "}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:15.023370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:15.031248 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-66691aed-74f8-4f59-9a01-aae026d82171 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1512 microversion: 2.1 time: 0.167250 Aug 25 03:11:15.031816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 310/601] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:14 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:15.055180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] validate_networks() for [('6ac69087-e8de-47de-ba66-364375da66dd', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:11:15.427614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:11:15.428028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:11:15.429023 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:11:15.429427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:11:15.429823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:11:15.438433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:15.438901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:15.439320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:15.440024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:15.440495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:15.440920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:15.457690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:11:15.461721 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Getting quotas for user fe93db6503a143ab9ed50fedbc8f010f and project 1d3d0ec7db3c4b3b8625c575a2a11ec8. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:11:15.472355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:11:15.474609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:11:15.638511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a9f98472-b93b-4b33-9787-9b935b839ca1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.698003 Aug 25 03:11:15.639499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 292/602] 10.222.0.75 () {62 vars in 1188 bytes} [Thu Aug 25 03:11:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 25 03:11:15.650435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:15.651169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:15.707683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:15.716166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:15.718323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:15.719101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8ad36436-0dc8-4831-b620-792446ab729e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1282 microversion: 2.20 time: 0.072872 Aug 25 03:11:15.719952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 311/603] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:15 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:16.052914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:16.054163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:16.060197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:16.060681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:16.061116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:16.061802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:16.062246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:16.062668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:16.081325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:16.266855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3eb59da-443d-4d19-842b-972b947331ca", "name": "network-vif-deleted", "tag": "9f731190-6dbd-4181-af3f-32c35bb92186"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:16.278814 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:16.279491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:16.279922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:16.285247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:16.290707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] Creating event network-vif-deleted:9f731190-6dbd-4181-af3f-32c35bb92186 for instance c3eb59da-443d-4d19-842b-972b947331ca on hv-cinder-77957 Aug 25 03:11:16.293690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-98a3fd10-3c08-4a9c-b5a2-15039e5a8cb5 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 200 len: 1512 microversion: 2.1 time: 0.245212 Aug 25 03:11:16.294350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 293/604] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:16 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 1512 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:16.296069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-6e50b1f4-58a8-46f6-befb-c94f0e537718 req-ad1589a3-d518-409d-af87-2c7b7d623aa8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033120 Aug 25 03:11:16.296862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 312/605] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:11:16.742226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:16.742826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:16.749221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:16.749702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:16.750131 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:16.750841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:16.751287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:16.751964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:16.812632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:16.820611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:16.822091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:16.823176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b6a1e9e8-e442-4285-b546-5f92c161b7bd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1286 microversion: 2.20 time: 0.085678 Aug 25 03:11:16.823721 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 294/606] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:16 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:17.317955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:17.319174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: c3eb59da-443d-4d19-842b-972b947331ca] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:17.326755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:17.327235 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:17.327730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:17.328517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:17.328976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:17.330036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:17.345302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] HTTP exception thrown: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Request method failure captured: Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca HTTP/1.1 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBugTN8VAkniVAojOljGvhdcLOP9nAYq3PgE3YtgaVoJAmBFCB1H1SKzTGaN6tKojZ44F1ZUVzKBRYH51rNi4DS0xRvkggz1kqdRnKppMqcicg8Aqvn2DAAjitX_znnXUygCcSHYdgnZ_4aicMgLbY1pDW24apzhf7hvj_rIppuTOCA8 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: aa73d487b3884350889e14e0b018e0f1 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:11:17.347216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aa73d487b3884350889e14e0b018e0f1"}]}] Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: aa73d487b3884350889e14e0b018e0f1 Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesSnapshotTestJSON-689048173-project Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: be1baf177c664022ac3e872df3a3cd27 Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesSnapshotTestJSON-689048173-project Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. Aug 25 03:11:17.348604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'c3eb59da-443d-4d19-842b-972b947331ca'} Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:11:17.349586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. Aug 25 03:11:17.350981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:17.352607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Returning 404 to user: Instance c3eb59da-443d-4d19-842b-972b947331ca could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:11:17.352607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-91b0a98d-57fc-4ed3-be68-49d55c83ecdc tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca" status: 404 len: 111 microversion: 2.1 time: 0.035333 Aug 25 03:11:17.352607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 313/607] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:17 2022] GET /compute/v2.1/servers/c3eb59da-443d-4d19-842b-972b947331ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:11:17.846405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:17.846999 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:17.854604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:17.855086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:17.855511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:17.856216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:17.856661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:17.857075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:17.965069 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:17.974562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:17.976753 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:17.982604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4c952eca-e667-4961-8841-5f46804ccd08 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1342 microversion: 2.20 time: 0.135419 Aug 25 03:11:17.982604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 295/608] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:17 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1342 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:19.000974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:19.001961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:19.008837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:19.009324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:19.009760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:19.010501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:19.010899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:19.011320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:19.141041 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:19.149657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:19.151161 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:19.152280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-213069f7-7507-48a9-8389-ad1ef5634fa4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.155176 Aug 25 03:11:19.152828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 314/609] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:18 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:20.174920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:20.175525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:20.181987 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:20.182441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:20.182874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:20.183552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:20.184001 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:20.184446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:20.316037 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:20.324812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:20.327181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:20.328593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-06c93072-e5f9-4ae3-86f7-b3d4e4b64fde tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.157564 Aug 25 03:11:20.330609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 296/610] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:20 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:20.946094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:20.948749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:20.955615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:20.956179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:20.956617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:20.957350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:20.957799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:20.958242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:20.988216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-31356990-014f-4f69-a87f-cd9dd695c185 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047205 Aug 25 03:11:20.988999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 315/611] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:20 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:11:21.052743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:21.053868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:21.059937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.060467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.060907 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.061597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.062049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.062471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.088209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:11:21.351300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:21.351906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:21.357977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.358454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.358884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.359574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.360021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.360464 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.458587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e7fd408c-e9e4-44b2-a84e-1db24cb5b2f7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 204 len: 0 microversion: 2.1 time: 0.408271 Aug 25 03:11:21.459948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 297/612] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:11:21 2022] DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:11:21.468304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:21.469140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:21.475541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.475986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.476491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.477186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.477637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.478063 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.494588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:21.503622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:21.505806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:21.508115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-df4aca3b-11bd-4f5e-8198-d7bc0431cc60 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.161087 Aug 25 03:11:21.509046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 316/613] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:21 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:21.513757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:21.524323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:21.524991 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:21.525610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:21.539469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] Creating event network-changed:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:11:21.544473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-f1bd5ef1-a0cf-48e5-b4d8-fd6c80918e1d req-b26cee41-5e9e-43e2-b236-d06878b60f77 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034153 Aug 25 03:11:21.545068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 317/614] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:21.636332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:21.644057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-09dfdd36-b7bb-4b8a-9818-8c68ac894bc4 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1672 microversion: 2.1 time: 0.179862 Aug 25 03:11:21.644657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 298/615] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:21 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:22.535059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:22.535818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:22.542990 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:22.543462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:22.543889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:22.544700 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:22.545154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:22.545572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:22.664604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:11:22.664805 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:11:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 (ip 10.222.0.75) !!! Aug 25 03:11:22.677757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:22.687059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:22.688568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:22.689654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b5139ac1-df38-4c23-b89f-38536899e875 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.158939 Aug 25 03:11:22.690211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 318/616] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:22 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:22.769934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:22.770537 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:22.776946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:22.777417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:22.777846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:22.778519 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:22.778961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:22.779373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:22.909222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:22.918214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-23e2f896-0f11-4988-b357-136af6436732 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1672 microversion: 2.1 time: 0.257035 Aug 25 03:11:22.918793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 299/617] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:22 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:23.712768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:23.713490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:23.717256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:23.720604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:23.721087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:23.721520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:23.722214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:23.722665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:23.723137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:23.862045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:23.870829 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:23.872377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:23.873469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-719c2c00-e699-4575-8c9b-47474a2f653f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.165366 Aug 25 03:11:23.874289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 319/618] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:23 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:11:23.939470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:23.940184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:23.942816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:23.948752 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:23.949325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:23.949814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:23.950511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:23.950962 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:23.951379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:24.253589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:24.262331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-105e1402-1c61-4445-8ac8-fbf2f4cb9744 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1672 microversion: 2.1 time: 0.326694 Aug 25 03:11:24.262931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 300/619] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:23 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1672 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:24.896815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:24.897740 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:24.904034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:24.904869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:24.905392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:24.906035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:24.906482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:24.907327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:24.982278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "832b5cf4-2011-4790-8c89-e4078b8cf262", "name": "network-vif-deleted", "tag": "b1565188-c9dd-4f38-9acf-24035dbedd9f"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:24.993786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:24.996655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:24.996655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:25.007187 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] Creating event network-vif-deleted:b1565188-c9dd-4f38-9acf-24035dbedd9f for instance 832b5cf4-2011-4790-8c89-e4078b8cf262 on hv-cinder-77957 Aug 25 03:11:25.012345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-e1a1edce-72ac-458a-9e8e-43e47e511282 req-a0c02585-435f-41f7-ba2c-56360217e422 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034058 Aug 25 03:11:25.013284 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 301/620] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:25.055469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:25.063806 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:25.065727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:25.066400 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-57f19572-61ce-48dc-878f-d33acf5d1968 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.174104 Aug 25 03:11:25.067133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 320/621] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:24 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:25.285510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:25.286287 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:25.293290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:25.293768 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:25.294195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:25.294878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:25.295326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:25.295744 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:25.359381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:25.367311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9c73ff4b-78cc-4ead-9845-be6fe910823a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1604 microversion: 2.1 time: 0.086414 Aug 25 03:11:25.367893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 302/622] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:25 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:26.088897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:26.089531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:26.091367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.096592 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:26.097073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:26.097511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:26.098225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:26.098678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:26.099104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:26.232635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:26.241316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:26.242955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:26.244048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1b3a696e-13df-4103-823c-5f61b0be633d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.159195 Aug 25 03:11:26.244683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 321/623] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:26 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:26.388400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:26.389018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:26.390947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.391637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=10 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.396866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:26.397408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:26.397845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:26.398524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:26.398965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:26.399379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:26.464426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:26.471934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-705aec6d-4702-49e6-9bc8-a6b6468800dd tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1604 microversion: 2.1 time: 0.087349 Aug 25 03:11:26.472651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 303/624] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:26 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1604 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:27.266929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:27.267448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:27.274631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:27.275120 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:27.275557 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:27.276290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:27.276743 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:27.277199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:27.408711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:27.417619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:27.419162 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:27.420321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-453c9c2d-f16e-455b-a5f7-68eb40105ee6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.157369 Aug 25 03:11:27.420880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 322/625] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:27 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:27.493703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:27.494428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:27.500850 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:27.501586 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:27.502012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:27.502686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:27.503133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:27.503545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:27.570136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:27.577919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9da79fee-0152-46bd-9214-3857d34538cc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 200 len: 1604 microversion: 2.1 time: 0.088279 Aug 25 03:11:27.578479 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 304/626] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:27 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 1604 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:27.907707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1258905800", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "networks": [{"uuid": "93f094cc-75b2-48ea-b047-edaab0694da3"}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:27.962276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] validate_networks() for [('93f094cc-75b2-48ea-b047-edaab0694da3', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:11:28.356622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:11:28.357304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:11:28.357526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:11:28.357928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:11:28.358333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:11:28.367097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.367570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.368006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.368753 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.369200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.369620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.386636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Getting quotas for project aa73d487b3884350889e14e0b018e0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:11:28.390566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Getting quotas for user be1baf177c664022ac3e872df3a3cd27 and project aa73d487b3884350889e14e0b018e0f1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:11:28.402726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:11:28.405164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:11:28.442251 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:28.443002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:28.450350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.450930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.451437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.452266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.452768 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.453199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.505532 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a41af7a1-982e-4919-bad4-1b4e8bb7928e tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601518 Aug 25 03:11:28.506912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 323/627] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:11:28.518314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9a9c03c0-5147-42cd-9a20-6ce4d2f6a91d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:28.518919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9a9c03c0-5147-42cd-9a20-6ce4d2f6a91d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:28.597175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9a9c03c0-5147-42cd-9a20-6ce4d2f6a91d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:28.612590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:28.613091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9a9c03c0-5147-42cd-9a20-6ce4d2f6a91d tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1219 microversion: 2.1 time: 0.092407 Aug 25 03:11:28.613091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 324/628] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:28 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:28.613091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:28.613091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:28.618486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.619106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.619655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.620655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:28.621209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:28.621735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:28.626039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:28.627951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:28.629271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5435fc41-2cc5-4608-aa07-e5268b0a5492 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.190938 Aug 25 03:11:28.630003 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 305/629] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:28 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:11:28.644717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 HTTP/1.1 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:11:28.647384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:11:28.648985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '832b5cf4-2011-4790-8c89-e4078b8cf262'} Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:11:28.649865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:11:28.651306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:11:28.652548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:11:28.652548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-838df6bb-6503-443b-b08a-d9749902cef1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 404 len: 111 microversion: 2.1 time: 0.040955 Aug 25 03:11:28.652548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 325/630] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:28 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:11:28.657849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-193adfbc-4339-489b-adc5-14823201eb4b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '.version_select at 0x7ff193a95550>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:28.745517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-193adfbc-4339-489b-adc5-14823201eb4b tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669693590" status: 202 len: 0 microversion: 2.1 time: 0.091450 Aug 25 03:11:28.746183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 306/631] 10.222.0.75 () {58 vars in 1221 bytes} [Thu Aug 25 03:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1669693590 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:11:29.527972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e70cf98e-cd32-4802-9a98-f3e35eda5e7d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: .version_select at 0x7ff197b489d0>, body: {"keypair": {"name": "tempest-keypair-198985181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImxNtYHhjUAh0RF3ah6WX6Ujc1aK7DWZWTTZLGeL++a4ENDuI/nG8yZlb5UxRA7/aTo5gWP7227qzVLPWEVTiJuGPHyBsjDpEmy6CxegAgc1Pre5k7vtaIUlYTRNX7o/Q=="}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:29.544054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-e70cf98e-cd32-4802-9a98-f3e35eda5e7d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:11:29.548254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-e70cf98e-cd32-4802-9a98-f3e35eda5e7d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for user 804df9333a474723968f97eb9d6bfc69 and project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:11:29.628012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:29.628845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:29.636676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:29.637392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:29.637920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:29.638821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:29.639428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:29.639997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:29.641271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e70cf98e-cd32-4802-9a98-f3e35eda5e7d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117160 Aug 25 03:11:29.641920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 326/632] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:11:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:29.657646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:29.658445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:29.666176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:29.666667 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:29.667100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:29.668055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:29.668534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:29.668954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:29.708796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:29.718441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-aef06f12-4cf5-4715-a30f-9e6681c196cb tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1223 microversion: 2.1 time: 0.095461 Aug 25 03:11:29.720310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 307/633] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:29 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:29.834125 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:29.842640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:29.844124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:29.845246 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8ebe3a95-6dfc-4097-aae1-db4286888954 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.192004 Aug 25 03:11:29.845802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 327/634] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:29 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:30.739715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:30.741920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:30.747942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:30.748725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:30.748977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:30.749671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:30.750123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:30.750526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:30.835316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:30.844039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5cc68ff0-a726-4fea-8b68-1e0cb1558f25 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1279 microversion: 2.1 time: 0.108932 Aug 25 03:11:30.844851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 308/635] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:30 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1279 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:30.867446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:30.868034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:30.874718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:30.875422 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:30.875856 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:30.876836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:30.877282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:30.877704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:31.091760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:31.101937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:31.103470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:31.104971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d0b8e92d-44f3-4450-af89-b0d9d8ecacf0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.242100 Aug 25 03:11:31.117021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 328/636] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:30 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:31.153633 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "name": "network-vif-plugged", "status": "completed", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:31.166270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:31.166957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:31.168907 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:31.179192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] Creating event network-vif-plugged:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:11:31.184329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-285690ac-ec3b-47d4-a9ac-51064f4c20f2 req-f317acc0-79d0-423e-a1c4-a54ace0beee0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Aug 25 03:11:31.184934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 309/637] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:31.871166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:31.872732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:31.879791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:31.880597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:31.881946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:31.882938 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:31.883604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:31.884298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.047220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:32.055597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-32bc6e6b-a1d6-42ae-867a-464775b7afb9 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.188375 Aug 25 03:11:32.056380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 329/638] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:31 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:32.130490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:32.132372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:32.138707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:32.139195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:32.139793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.140558 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:32.141014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:32.141484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.301735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-718312873", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f35a7bb-9c1a-41d2-92fd-9043716fc14c"}], "security_groups": [{"name": "tempest-securitygroup--1238763017"}], "key_name": "tempest-keypair-198985181", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:32.347640 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:32.352609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:32.364827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:32.364827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:32.374165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a6b2b701-65c9-424d-a941-b368b8b544a0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.239424 Aug 25 03:11:32.374731 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 310/639] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:32 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:32.418126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] validate_networks() for [('1f35a7bb-9c1a-41d2-92fd-9043716fc14c', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:11:32.530430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d4e9c0-0a99-4b43-a085-a04a93fee7ab", "tag": "ea945c98-0ff2-499e-b846-3070588ded2d"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:32.539279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:32.539746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:32.540184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.557507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] Creating event network-changed:ea945c98-0ff2-499e-b846-3070588ded2d for instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab on hv-cinder-77957 Aug 25 03:11:32.562282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-464e9751-594f-4192-be21-04dc7c11e275 req-c167676b-4d88-44fb-996a-2977917e8ca7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037406 Aug 25 03:11:32.562958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 311/640] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:32.810951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:11:32.811461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:11:32.812073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:11:32.812513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:11:32.812924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:11:32.822159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:32.822639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:32.823071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.823818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:32.824317 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:32.824744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:32.842267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:11:32.846553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Getting quotas for user 804df9333a474723968f97eb9d6bfc69 and project f626c34f12fb4bdab6bd42b05b79742a. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:11:32.858423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:11:32.860613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:11:33.015118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a544202f-c9e2-42d6-b6af-93cadd321b15 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717595 Aug 25 03:11:33.016137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 330/641] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:11:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:11:33.028160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-336ec76f-0e6e-4174-b441-b7fa6b363307 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:33.028937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-336ec76f-0e6e-4174-b441-b7fa6b363307 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:33.077403 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:33.078308 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:33.087202 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-336ec76f-0e6e-4174-b441-b7fa6b363307 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:33.088130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:33.088648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:33.089107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:33.089805 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:33.091175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:33.091676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:33.095124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-336ec76f-0e6e-4174-b441-b7fa6b363307 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1236 microversion: 2.1 time: 0.071345 Aug 25 03:11:33.097246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 312/642] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:33 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:33.234672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:33.243769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1f405a72-687a-4e8c-91ef-11f4606694e2 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.170067 Aug 25 03:11:33.244542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 331/643] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:33 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:33.397348 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:33.397945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:33.404976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:33.405887 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:33.406728 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:33.407918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:33.408463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:33.408955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:33.659544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:33.669393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:33.670900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:33.672075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d2877391-27ac-4126-85e1-8eef085bd0f1 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1408 microversion: 2.20 time: 0.279138 Aug 25 03:11:33.672672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 313/644] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:33 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:34.116105 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:34.116796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:34.123275 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.123791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.124261 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.125064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.125522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.125951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.188824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:34.196788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-79b5f321-3b1e-42ec-af79-824169375856 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1240 microversion: 2.1 time: 0.084395 Aug 25 03:11:34.197411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 332/645] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:34 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:34.264794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:34.265389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:34.272472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.272946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.273368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.274073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.274511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.274922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.402895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:34.410582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3a563cd6-9d80-42e5-9b25-c4bc5b7dfeaf tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.149568 Aug 25 03:11:34.411144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 314/646] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:34 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:34.697815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:34.698352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:34.704342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.704834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.707366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.707366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.707366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.707366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.710914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:34.838010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:34.846052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:34.847547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:34.848730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f6b0cb63-3a95-4941-b9e1-740614860e52 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1600 microversion: 2.20 time: 0.155160 Aug 25 03:11:34.849424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 333/647] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:11:34 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:11:34.873186 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:34.873667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:34.879727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.880227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.880690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.881466 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:34.881910 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:34.882320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:34.960331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2830a586-0f21-4fac-b6b0-8865df45c9b6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090872 Aug 25 03:11:34.960919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 315/648] 10.222.0.75 () {60 vars in 1316 bytes} [Thu Aug 25 03:11:34 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:11:35.217245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:35.218595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:35.225453 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:35.225983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:35.226439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:35.227144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:35.227712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:35.228409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:35.326587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:35.335328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-77faa779-5fb1-4723-adf9-46cfe1e2249d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1232 microversion: 2.1 time: 0.121948 Aug 25 03:11:35.335909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 334/649] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:35 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1232 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:35.431677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:35.432492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:35.438605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:35.439096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:35.439527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:35.440298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:35.440748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:35.441171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:35.582112 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:35.591485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-563b3c65-32cd-4417-a51e-a4d73a2c4595 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.164333 Aug 25 03:11:35.592052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 316/650] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:35 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:36.270624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:36.281069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:36.281902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:36.282401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:36.294801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] Creating event network-changed:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:11:36.300238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-83151692-518f-485b-90d0-671d5057727f req-391a35aa-53e3-4bab-9e27-cde8cb953930 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112988 Aug 25 03:11:36.303353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 335/651] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:36.356993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:36.357871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:36.363949 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:36.365921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:36.365921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:36.366575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:36.367095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:36.367623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:36.486558 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:36.496735 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-69d02b0f-c481-482a-8958-a945ee418e89 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1294 microversion: 2.1 time: 0.143951 Aug 25 03:11:36.509183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 317/652] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:36 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1294 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:36.614792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:36.614792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:36.622117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:36.622810 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:36.623344 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:36.624481 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:36.625240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:36.625872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:36.774438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:36.779920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-909cc3b2-97ae-499d-b7b7-62ef4a261c53 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.170232 Aug 25 03:11:36.780887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 336/653] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:36 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:37.523358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:37.524047 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:37.530492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:37.530968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:37.531393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:37.532111 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:37.532582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:37.532992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:37.743180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:37.750920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2e5b7572-274c-4a46-a8a4-484863515ef0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.232252 Aug 25 03:11:37.753045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 318/654] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:37 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:37.801008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:37.801608 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:37.808964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:37.809448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:37.809873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:37.810565 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:37.811008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:37.811425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:37.955927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:37.964886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-60151d1c-bd1a-4278-9e35-ec3aafea38b3 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.167709 Aug 25 03:11:37.965579 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 337/655] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:37 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:38.194626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c844d8f2-8bd9-404d-81ec-6f829ab49551", "tag": "8931bd40-0fa3-4f84-acad-d8230437317d"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:38.204274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:38.204677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:38.205252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:38.216632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] Creating event network-changed:8931bd40-0fa3-4f84-acad-d8230437317d for instance c844d8f2-8bd9-404d-81ec-6f829ab49551 on hv-cinder-77957 Aug 25 03:11:38.221138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-e4499a3b-c887-4166-9ed3-c7b6df01d3a9 req-7bf3fa62-aa0f-4329-8fa2-298ec1caa92d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088269 Aug 25 03:11:38.221727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 319/656] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:38.772079 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:38.772621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:38.778616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:38.779098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:38.779571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:38.780609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:38.780696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:38.781114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:38.913282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:38.920936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-db032eb8-86e3-44e3-9e02-235452afc032 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.153085 Aug 25 03:11:38.921504 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 338/657] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:38 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:38.986556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:38.987308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:38.994052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:38.994533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:38.994956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:38.995627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:38.996066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:38.996502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:39.132493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:39.140109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8e314992-d784-44b4-876f-6cd8f1c146ce tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.158220 Aug 25 03:11:39.140700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 320/658] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:38 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:39.156876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d4e9c0-0a99-4b43-a085-a04a93fee7ab", "name": "network-vif-plugged", "status": "completed", "tag": "ea945c98-0ff2-499e-b846-3070588ded2d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:39.167278 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:39.167910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:39.168506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:39.180519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] Creating event network-vif-plugged:ea945c98-0ff2-499e-b846-3070588ded2d for instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab on hv-cinder-77957 Aug 25 03:11:39.185637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-fbfac869-40fd-40fb-bf3d-b415372fe395 req-37725e8d-fc60-4161-8e13-09e9e3c3cb76 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Aug 25 03:11:39.186214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 339/659] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:39.942473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:39.943727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:39.949815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:39.950299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:39.950737 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:39.951424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:39.951874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:39.952327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:40.160427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:40.161116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:40.169650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:40.170135 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:40.170566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:40.171255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:40.171698 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:40.172116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:40.190592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:40.201002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1c09108d-e1f4-4e56-8a9c-5eb48a85141d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.262143 Aug 25 03:11:40.201573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 321/660] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:39 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:40.311116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:40.319424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-df3d75a3-99a7-4794-9dd1-07788bc7f955 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1319 microversion: 2.1 time: 0.163179 Aug 25 03:11:40.320003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 340/661] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:40 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:41.223057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:41.223637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:41.230841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.231317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.231774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:41.232484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.232956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.233417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:41.338827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:41.339457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:41.346046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.346531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.346966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:41.354551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.355076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.355519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:41.373192 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:41.381611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-87d1b570-a49f-413b-a11e-9d063a2cd3d5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.162488 Aug 25 03:11:41.382180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 322/662] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:41 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:41.485925 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:41.494434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f1a018a0-fa1b-4aea-86ce-3e48a9d8d131 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1507 microversion: 2.1 time: 0.159467 Aug 25 03:11:41.495014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 341/663] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:41 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:41.514624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30fc1d6a-f717-4ae5-93f9-9ff4f1ff951a", "device": "/dev/sdb"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:41.517542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:41.523886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.524400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.524828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:41.525513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:41.525957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:41.526371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.232020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:42.232547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:42.238664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.239149 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.239682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.240920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.241450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.241878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.323284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'services' on Instance uuid e2617bf5-70b8-4eb3-81ee-563d8d7e57ae {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:11:42.528591 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a024a64a-3ac1-4db9-b0b1-bde872b1cb57 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "POST /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.017622 Aug 25 03:11:42.529236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 323/664] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:11:41 2022] POST /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:42.534259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:42.534950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:42.543326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.543822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.544293 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.544997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.545454 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.547201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.572643 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c0e1ddf4-35e1-4667-b001-b49549b3edf1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments/6e7b2319-1763-47a2-912e-30ef861db124" status: 202 len: 0 microversion: 2.1 time: 0.344177 Aug 25 03:11:42.573423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 342/665] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:11:42 2022] DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments/6e7b2319-1763-47a2-912e-30ef861db124 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:11:42.582470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:42.588686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:42.601824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.602357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.602996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.603733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:42.604214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:42.604659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:42.636014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-94c06b3e-7de5-4ca8-9279-c3dafe7aa9f8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057948 Aug 25 03:11:42.636986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 343/666] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:42 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:42.690908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:42.700455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c0e630b5-29d8-417a-9676-4a1ee9008573 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.169875 Aug 25 03:11:42.701521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 324/667] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:42 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:43.176476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c844d8f2-8bd9-404d-81ec-6f829ab49551", "name": "network-vif-plugged", "status": "completed", "tag": "8931bd40-0fa3-4f84-acad-d8230437317d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:43.181986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=4 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:43.182649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=18 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:43.187852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:43.191448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:43.191448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:43.199920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] Creating event network-vif-plugged:8931bd40-0fa3-4f84-acad-d8230437317d for instance c844d8f2-8bd9-404d-81ec-6f829ab49551 on hv-cinder-77957 Aug 25 03:11:43.204809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-7f6bf58b-d88e-46c4-8bc0-510f03d4eeab req-0e99a310-1fd6-4575-abaf-45101d62ff2e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032326 Aug 25 03:11:43.205581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 344/668] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:43.649265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:43.651687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:43.654092 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:43.658908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:43.659389 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:43.671617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:43.671617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:43.671617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:43.671617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:43.690663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-76ac76f7-0fda-402b-94df-707a246430ea tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046021 Aug 25 03:11:43.691229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 325/669] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:43 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:43.725402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:43.726029 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:43.733269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:43.733744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:43.734176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:43.734893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:43.735343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:43.735767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:43.866640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:43.874237 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-002eac01-edf2-4e23-84d9-67449671c859 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.153659 Aug 25 03:11:43.874799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 345/670] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:43 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:44.702822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:44.705230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:44.714567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:44.715044 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:44.715471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:44.716183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:44.716629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:44.717042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:44.746922 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e9f5d017-04fa-48c2-b172-111825b8ef23 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047870 Aug 25 03:11:44.749948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 326/671] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:44 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:44.895781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:44.896408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:44.903002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:44.903474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:44.903902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:44.904607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:44.905059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:44.905476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:45.035675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:45.043392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b4a542b6-eed5-4ec4-83c0-23fdf0cbb8da tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1362 microversion: 2.1 time: 0.151410 Aug 25 03:11:45.043955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 346/672] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:44 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:45.759360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:45.761529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:45.767823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:45.768337 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:45.768765 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:45.769440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:45.769878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:45.770291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:45.799538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-40f0ba90-d8af-4824-b4bb-0dc19b840369 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 25 03:11:45.800086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 327/673] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:45 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:46.069069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:46.069069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:46.071426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.071945 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.072467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.073167 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.073625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.074052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.209277 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:46.217071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9cb37611-c317-4f99-b8ed-c601edce9de2 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1546 microversion: 2.1 time: 0.157483 Aug 25 03:11:46.217634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 347/674] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:46 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:46.237877 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:46.238366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:46.244949 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.245432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.245908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.246577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.247027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.247449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.325759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b718d41d-026e-4787-9628-540a65afe53e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091836 Aug 25 03:11:46.326358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 328/675] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:11:46 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:46.811293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:46.813672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:46.815986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:46.821651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.822132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.822568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.823260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:46.823701 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:46.824120 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:46.855438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-83e0abd5-9be1-4035-b626-d5495032f02d tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047948 Aug 25 03:11:46.857216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 348/676] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:46 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:47.329318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c844d8f2-8bd9-404d-81ec-6f829ab49551", "tag": "8931bd40-0fa3-4f84-acad-d8230437317d"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:47.338571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:47.339039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:47.339467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:47.343143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:47.351148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] Creating event network-changed:8931bd40-0fa3-4f84-acad-d8230437317d for instance c844d8f2-8bd9-404d-81ec-6f829ab49551 on hv-cinder-77957 Aug 25 03:11:47.356128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-d7198d0b-7e2a-4024-8005-c91f802a3291 req-35cb23b2-5902-4428-aa04-be64779bede9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030973 Aug 25 03:11:47.358553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 329/677] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:47.873589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:47.876677 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:47.894393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:47.895066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:47.896707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:47.897622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:47.898240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:47.898664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:47.933764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-59c10f2c-2d27-4b21-9eb7-6893e88cadb9 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068998 Aug 25 03:11:47.934446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 349/678] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:47 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:48.951090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:48.953360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:48.960473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:48.960953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:48.961386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:48.962075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:48.962629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:48.962934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:48.992996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c30f8f3e-42cf-4e4e-b677-6bc152e8f9f7 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046518 Aug 25 03:11:48.993559 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 330/679] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:48 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:50.004848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:50.007114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:50.013482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:50.013962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:50.018846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:50.018846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:50.018846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:50.018846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:50.047165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-696308cb-bf7d-4cbf-8029-d4e780f59f4e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Aug 25 03:11:50.047737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 350/680] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:49 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:11:51.059591 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:51.061652 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:51.069120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.069592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.070024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.070703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.071146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.071562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.100933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-95e7cd9f-fe6a-43ae-bf69-3f9f071e3c4b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045723 Aug 25 03:11:51.101485 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 331/681] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:11:51 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:11:51.182269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:51.182785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:51.189058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.189538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.189977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.190662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.191113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.191536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.196369 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:51.217647 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:11:51.530536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-31d5bc68-7fb5-489c-a61a-9e48c569ac3e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 204 len: 0 microversion: 2.1 time: 0.351797 Aug 25 03:11:51.531129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 351/682] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:11:51 2022] DELETE /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:11:51.539651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:51.540501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:51.546891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.547379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.547815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.548659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:51.549107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:51.549529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:51.687426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:51.695504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-470f1baa-e47e-4147-b82e-770468efebb0 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.159890 Aug 25 03:11:51.696103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 332/683] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:51 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:11:52.719098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:52.719782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:52.726880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:52.727359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:52.727789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:52.728506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:52.728952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:52.729372 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:52.861658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:52.869391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-18444de1-53f2-4ebb-bc37-96a6eebb4679 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.154462 Aug 25 03:11:52.869958 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 352/684] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:52 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:53.890427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:53.891029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:53.898382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:53.898864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:53.899296 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:53.899981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:53.900467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:53.900888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:54.029242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:54.037414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2859a51e-acb5-4743-8386-7b3281c22816 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.150484 Aug 25 03:11:54.037993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 333/685] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:53 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:55.059008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:55.059611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:55.066113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:55.066596 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:55.067029 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:55.068641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:55.069236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:55.069669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:55.196617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:55.204293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fe1161bc-fc12-46df-9fcf-3807a9e51b6f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.149177 Aug 25 03:11:55.204867 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 353/686] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:55 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:56.226334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:56.235257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:56.235257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:56.235257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:56.235257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:56.235635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:56.235768 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:56.236241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:56.236653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:56.369567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:56.377451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7c634989-6128-485d-8c25-d3f3d5599ae6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.155847 Aug 25 03:11:56.378013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 334/687] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:56 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:57.398896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:57.399492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:57.406069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:57.406546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:57.409724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:57.409724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:57.409724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:57.409724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:57.541260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:57.549006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-44d45681-f373-46ed-a5bf-88b835836fd2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.154107 Aug 25 03:11:57.553114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 354/688] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:57 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:58.571977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:58.572645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:58.579115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:58.579617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:58.580013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:58.580725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:58.581179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:58.581602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:58.742952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:58.751403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-45c57c87-936e-4595-a0f3-99196e7ef5a6 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1686 microversion: 2.1 time: 0.183937 Aug 25 03:11:58.751881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 335/689] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:58 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:59.776611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:11:59.777880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:11:59.785264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:59.786093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:59.787443 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:59.788415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:59.789043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:59.789628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:59.860931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:11:59.870198 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ead9e65c-7fc9-446a-bce9-25143fca66aa tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1619 microversion: 2.1 time: 0.097642 Aug 25 03:11:59.872984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 355/690] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:11:59 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1619 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:11:59.935597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2617bf5-70b8-4eb3-81ee-563d8d7e57ae", "name": "network-vif-deleted", "tag": "a2034d10-a91b-4dcb-8ed7-42398e639214"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:11:59.949518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:11:59.951085 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:11:59.951513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:11:59.967424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] Creating event network-vif-deleted:a2034d10-a91b-4dcb-8ed7-42398e639214 for instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae on hv-cinder-77957 Aug 25 03:11:59.972573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-2396bb6a-52ff-410c-a145-a86c8e586dc4 req-1568e1da-16ac-435d-960c-f8a4b8d793fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047838 Aug 25 03:11:59.973343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 336/691] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:00.893616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:00.894260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:00.900680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:00.901194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:00.901665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:00.902406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:00.902882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:00.903318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:00.937476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:00.937966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:00.938414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:00.938863 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'fault' on Instance uuid e2617bf5-70b8-4eb3-81ee-563d8d7e57ae {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:00.982173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:00.990735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8a779417-a4d7-4adb-a45e-97a8eb542f5c tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 200 len: 1334 microversion: 2.1 time: 0.100849 Aug 25 03:12:00.991737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 356/692] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:00 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:02.018130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:02.018826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e2617bf5-70b8-4eb3-81ee-563d8d7e57ae] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:02.025950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:02.026436 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:02.026870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:02.027561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:02.028013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:02.028475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:02.041994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] HTTP exception thrown: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Request method failure captured: Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae HTTP/1.1 Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBucpU8RUMeS449pGN11FAVpH-9_b7FTynxGl66lliI6ZBAMCljHcZQW0qCHHttc93uqHuQRCgwvBiNil4ZTvoLjysM1QcES1CegEVnIK99jTYnhO52FsK5I-7afZxLIDszMyOWy8uuDquZI2kypGG0btXlRozOu9UC2pcKGeVUeILMQ Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:12:02.043592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d5a66dfea4c5492da1ac3e1f76cbe35d"}]}] Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 7daac509316048ec903a5d78d3586aad Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. Aug 25 03:12:02.045249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'e2617bf5-70b8-4eb3-81ee-563d8d7e57ae'} Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:02.046074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. Aug 25 03:12:02.047571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:02.048903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Returning 404 to user: Instance e2617bf5-70b8-4eb3-81ee-563d8d7e57ae could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:02.048903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7a83b323-9e77-46ea-8465-754b64af5681 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae" status: 404 len: 111 microversion: 2.1 time: 0.031084 Aug 25 03:12:02.048903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 337/693] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:02 2022] GET /compute/v2.1/servers/e2617bf5-70b8-4eb3-81ee-563d8d7e57ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:12:02.053872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b6fd0ee7-660d-4c0b-a438-f5cf03c0e9b2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '.version_select at 0x7ff197a32550>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:02.151152 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b6fd0ee7-660d-4c0b-a438-f5cf03c0e9b2 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301131760" status: 202 len: 0 microversion: 2.1 time: 0.101049 Aug 25 03:12:02.151728 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 357/694] 10.222.0.75 () {58 vars in 1218 bytes} [Thu Aug 25 03:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301131760 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:12:02.722402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:02.722402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:02.727589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:02.728095 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:02.728547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:02.729229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:02.729668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:02.730142 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:02.810940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lazy-loading 'services' on Instance uuid b7d4e9c0-0a99-4b43-a085-a04a93fee7ab {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:03.017442 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f44386ed-0f4c-4940-9541-2be43ceb337a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab/os-volume_attachments/30fc1d6a-f717-4ae5-93f9-9ff4f1ff951a" status: 202 len: 0 microversion: 2.1 time: 0.300599 Aug 25 03:12:03.018017 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 338/695] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:12:02 2022] DELETE /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab/os-volume_attachments/30fc1d6a-f717-4ae5-93f9-9ff4f1ff951a => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:12:05.216187 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:05.216718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:05.223530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.224320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.224847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.225543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.225998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.226425 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.256594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:12:05.558487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3b00eaf4-adcf-43bb-9050-eb833b89e173 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 204 len: 0 microversion: 2.1 time: 0.346575 Aug 25 03:12:05.559075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 358/696] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:12:05 2022] DELETE /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:12:05.564382 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:05.564955 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:05.567301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:05.568002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:05.573601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.574073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.574178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.574497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.574615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.574971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.575188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.575632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.575776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.576046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.576181 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.576546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.603559 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:12:05.711329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:05.719103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f881c21c-30b1-4401-82a7-ab9592c27400 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1513 microversion: 2.1 time: 0.155866 Aug 25 03:12:05.719662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 359/697] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:05 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:05.895181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7ac0f60a-e19e-4d48-867f-66a3202cd15a tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 204 len: 0 microversion: 2.1 time: 0.334625 Aug 25 03:12:05.896517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 339/698] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:12:05 2022] DELETE /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:12:05.904502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:05.905104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:05.911034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.911578 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.912011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:05.912773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:05.913226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:05.913654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:06.043912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:06.052444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-925454b1-f4fd-435f-9aee-b979471c8d81 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1507 microversion: 2.1 time: 0.151036 Aug 25 03:12:06.053023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 360/699] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:05 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:06.741946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:06.742640 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:06.749076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:06.749562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:06.749997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:06.750944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:06.751402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:06.751822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:06.881913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:06.889832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-377e57e5-a502-4bcc-9626-ab1b5e1d66ba tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1513 microversion: 2.1 time: 0.152797 Aug 25 03:12:06.890403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 340/700] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:06 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:07.073325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:07.073848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:07.080216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.080689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.081117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.081792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.082241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.083158 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.225385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:07.233739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6284e373-ba7f-43cd-86a5-a98bb40bf3c1 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1507 microversion: 2.1 time: 0.164237 Aug 25 03:12:07.234572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 361/701] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:07 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:07.253836 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:07.258505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:07.261143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.261661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.262093 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.262760 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.263201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.263614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.286947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lazy-loading 'flavor' on Instance uuid bb779de8-4034-4b32-a378-d65e4bbdbf71 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:07.528008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1a21b5a1-95fe-4f14-bc16-932c89f8c94d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "POST /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71/action" status: 202 len: 0 microversion: 2.1 time: 0.278197 Aug 25 03:12:07.528654 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 341/702] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:12:07 2022] POST /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:12:07.537484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:07.538086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:07.544035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.544555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.544987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.545672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.546124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.546549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.679509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:07.687335 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5bfa48cc-1b7b-4d98-83ec-8e60969630c7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.154207 Aug 25 03:12:07.688040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 362/703] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:07 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:07.912907 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:07.913696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:07.920493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.920975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.921406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:07.922093 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:07.922538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:07.922953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:08.054256 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:08.061799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-15c36d46-b258-4e87-b5ba-e5403fad156b tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1513 microversion: 2.1 time: 0.154399 Aug 25 03:12:08.062355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 342/704] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:07 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:08.257158 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:08.257672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:08.264013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:08.264533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:08.264944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:08.265639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:08.266063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:08.266475 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:08.396298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:08.403862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5f722507-c32e-46a8-b4f8-5eac1c69c6c3 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1507 microversion: 2.1 time: 0.151313 Aug 25 03:12:08.404451 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 363/705] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:08 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:08.709770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:08.710396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:08.716377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:08.716852 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:08.717274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:08.717941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:08.718460 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:08.718803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:08.737047 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:09.033471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:09.041267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c46c947a-8781-428a-a274-60c457dd6aa8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.335892 Aug 25 03:12:09.041835 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 343/706] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:08 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:09.086309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:09.086994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:09.093528 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:09.094013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:09.094448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:09.095140 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:09.095588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:09.096013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:09.230852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:09.239884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c65ce222-4feb-45e4-a4e2-2adbf16d77bd tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1513 microversion: 2.1 time: 0.157497 Aug 25 03:12:09.240706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 364/707] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:09 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:09.425176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:09.425778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:09.432311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:09.432795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:09.433227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:09.433912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:09.434394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:09.434824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:09.669489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d4e9c0-0a99-4b43-a085-a04a93fee7ab", "name": "network-vif-deleted", "tag": "ea945c98-0ff2-499e-b846-3070588ded2d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:09.679480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:09.679957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:09.684630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:09.699676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:09.704224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] Creating event network-vif-deleted:ea945c98-0ff2-499e-b846-3070588ded2d for instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab on hv-cinder-77957 Aug 25 03:12:09.708410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-bf69a5ed-8379-437e-bdd9-bd6cea95b53e req-41ed738e-ec27-46f5-84ad-99e722b41e57 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041833 Aug 25 03:12:09.709420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 365/708] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:09.711526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:09.727700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-02d89d8c-c369-49c2-98a1-10617f6feb20 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1507 microversion: 2.1 time: 0.303206 Aug 25 03:12:09.727700 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 344/709] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:09 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:10.063535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:10.078607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:10.078607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.078607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.078607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.079027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.079027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.079027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.215191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:10.222695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a282a940-840b-454c-ac78-a59568712407 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.163821 Aug 25 03:12:10.223367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 366/710] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:10 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:10.261250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:10.261790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:10.268239 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.268723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.269154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.269836 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.270812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.271244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.303250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.303722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.304236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.304674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lazy-loading 'fault' on Instance uuid b7d4e9c0-0a99-4b43-a085-a04a93fee7ab {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:10.349416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be1baf177c664022ac3e872df3a3cd27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa73d487b3884350889e14e0b018e0f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:10.357352 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0a385dd5-bbfe-4b2c-86c3-9d919f74e00a tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 200 len: 1309 microversion: 2.1 time: 0.100136 Aug 25 03:12:10.357919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 345/711] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:10 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:10.746309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:10.746909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:10.754521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.755412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.756379 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.757075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.757527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.757950 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.788508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:10.788987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:10.789420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:10.789953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lazy-loading 'fault' on Instance uuid e74280ff-4eca-4761-80a8-4a2dc9064abd {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:10.831392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:10.839405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1e2c2d3e-7ced-4476-a168-83bae41d93d8 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 200 len: 1312 microversion: 2.1 time: 0.096923 Aug 25 03:12:10.840018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 367/712] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:10 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:11.243834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:11.244500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:11.250723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.251203 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.251632 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.252342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.252843 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.253263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.379233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:11.380519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] [instance: b7d4e9c0-0a99-4b43-a085-a04a93fee7ab] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:11.386670 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.391912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.391912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.391912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.391912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.392285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.396496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:11.403627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] HTTP exception thrown: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. Aug 25 03:12:11.405099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bf5116d0-8c0a-4eaf-ae2a-f850a4f3263e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.165283 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Request method failure captured: Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab HTTP/1.1 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBugTN8VAkniVAojOljGvhdcLOP9nAYq3PgE3YtgaVoJAmBFCB1H1SKzTGaN6tKojZ44F1ZUVzKBRYH51rNi4DS0xRvkggz1kqdRnKppMqcicg8Aqvn2DAAjitX_znnXUygCcSHYdgnZ_4aicMgLbY1pDW24apzhf7hvj_rIppuTOCA8 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: aa73d487b3884350889e14e0b018e0f1 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:12:11.405300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aa73d487b3884350889e14e0b018e0f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aa73d487b3884350889e14e0b018e0f1"}]}] Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: aa73d487b3884350889e14e0b018e0f1 Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-689048173 Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesSnapshotTestJSON-689048173-project Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: be1baf177c664022ac3e872df3a3cd27 Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesSnapshotTestJSON-689048173-project Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. Aug 25 03:12:11.406819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'b7d4e9c0-0a99-4b43-a085-a04a93fee7ab'} Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:11.407694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. Aug 25 03:12:11.418479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.419563 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 346/713] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:11 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:11.419654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] Returning 404 to user: Instance b7d4e9c0-0a99-4b43-a085-a04a93fee7ab could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:11.419654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6c8b3d1a-f4ef-4413-bb3e-089c58af2fa1 tempest-VolumesSnapshotTestJSON-689048173 tempest-VolumesSnapshotTestJSON-689048173-project] 10.222.0.75 "GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab" status: 404 len: 111 microversion: 2.1 time: 0.031722 Aug 25 03:12:11.419654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 368/714] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:11 2022] GET /compute/v2.1/servers/b7d4e9c0-0a99-4b43-a085-a04a93fee7ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 25 03:12:11.734040 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74280ff-4eca-4761-80a8-4a2dc9064abd", "name": "network-vif-deleted", "tag": "ed1654d2-e4df-42ab-af33-04952194d07a"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:11.744178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.744655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.745074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.758960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] Creating event network-vif-deleted:ed1654d2-e4df-42ab-af33-04952194d07a for instance e74280ff-4eca-4761-80a8-4a2dc9064abd on hv-cinder-77957 Aug 25 03:12:11.762285 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-47053cbf-7306-426f-8063-2325d4a34f7e req-c7648fbd-bbd5-4af7-b011-09325d186d84 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031961 Aug 25 03:12:11.762951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 347/715] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:11.861315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:11.862292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: e74280ff-4eca-4761-80a8-4a2dc9064abd] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:11.871428 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.872042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.872636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.873511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.874082 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.874663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.889104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] HTTP exception thrown: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Request method failure captured: Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd HTTP/1.1 Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBucpU8RUMeS449pGN11FAVpH-9_b7FTynxGl66lliI6ZBAMCljHcZQW0qCHHttc93uqHuQRCgwvBiNil4ZTvoLjysM1QcES1CegEVnIK99jTYnhO52FsK5I-7afZxLIDszMyOWy8uuDquZI2kypGG0btXlRozOu9UC2pcKGeVUeILMQ Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:12:11.890619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d5a66dfea4c5492da1ac3e1f76cbe35d"}]}] Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 7daac509316048ec903a5d78d3586aad Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. Aug 25 03:12:11.892174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'e74280ff-4eca-4761-80a8-4a2dc9064abd'} Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:11.897482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. Aug 25 03:12:11.898964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:12:11.900291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Returning 404 to user: Instance e74280ff-4eca-4761-80a8-4a2dc9064abd could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:11.900291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8e29c4a3-f506-4b03-93fb-e49cb39e5f9f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd" status: 404 len: 111 microversion: 2.1 time: 0.035563 Aug 25 03:12:11.900291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 369/716] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:11 2022] GET /compute/v2.1/servers/e74280ff-4eca-4761-80a8-4a2dc9064abd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:12:11.901206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:11.901776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:11.907929 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.908432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.908861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.909533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:11.909975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:11.910391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:11.936514 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:12:12.226858 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cf8fbcd0-71bc-4db7-a552-0846287e2a34 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 204 len: 0 microversion: 2.1 time: 0.329478 Aug 25 03:12:12.227454 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 348/717] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:12:11 2022] DELETE /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:12:12.235487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:12.236165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:12.243097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:12.243599 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:12.244039 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:12.244759 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:12.245209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:12.245638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:12.381505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:12.389203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-576da083-2ad5-48fe-a1f0-f605e86ee81e tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.157626 Aug 25 03:12:12.389762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 370/718] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:12 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:12.426974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:12.427661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:12.434148 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:12.434623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:12.435048 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:12.435726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:12.436183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:12.448492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:12.574783 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:12.583053 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d53e3f90-18a8-467e-8166-1928a3944c3d tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.160041 Aug 25 03:12:12.585983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 349/719] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:12 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:13.410593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:13.411517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:13.418007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:13.418485 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:13.418915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:13.419686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:13.420136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:13.424366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:13.552797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:13.560511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4d9e63e0-7105-4a57-bc08-66933f7f1f8f tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.153654 Aug 25 03:12:13.561075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 371/720] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:13 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:13.604611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:13.605934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:13.614937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:13.615477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:13.615861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:13.616788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:13.617106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:13.619297 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:13.755894 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:13.759694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-24688bbb-e6ed-4e56-ad04-fd149830dc67 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.159206 Aug 25 03:12:13.760297 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 350/721] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:13 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:14.582136 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:14.583395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:14.589954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:14.590454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:14.590883 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:14.591595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:14.592059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:14.592501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:14.725427 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:14.733129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2f292e05-f89e-4771-8e46-7127788bf658 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.154757 Aug 25 03:12:14.733698 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 372/722] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:14 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:14.780159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:14.780771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:14.787538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:14.788011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:14.788461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:14.789136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:14.789578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:14.789991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:14.919523 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:14.927935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6fb86b08-63db-425c-8637-27fb450d2d09 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.151560 Aug 25 03:12:14.928602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 351/723] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:14 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:15.754595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:15.755330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:15.761865 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:15.762349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:15.762786 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:15.763469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:15.763919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:15.764378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:15.889107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:15.896850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ac53a34c-849c-40f1-93d6-fd4782475b3b tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.146358 Aug 25 03:12:15.897411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 373/724] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:15 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:15.949189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:15.949788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:15.956176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:15.956637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:15.957073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:15.957787 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:15.958226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:15.958639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:16.091292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:16.099815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ea30125a-17f7-4fe0-a5bb-5ef06af21bd7 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.154426 Aug 25 03:12:16.100421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 352/725] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:15 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:16.918220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:16.918868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:16.925415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:16.925900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:16.926988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:16.928010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:16.928497 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:16.928932 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:17.060879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:17.069175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-695d1108-b3f2-409a-9eb2-8b8f2a319845 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1521 microversion: 2.1 time: 0.155104 Aug 25 03:12:17.069744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 374/726] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:16 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:17.121229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:17.121826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:17.128872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:17.129471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:17.129974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:17.130742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:17.131289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:17.131718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:17.262410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:17.270215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d5360d9f-ad92-4ccf-9b8e-f345251415b8 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.152838 Aug 25 03:12:17.270933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 353/727] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:17 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:17.917659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbd488ac-822f-4fe0-9a52-b283ee2bea81", "name": "network-vif-deleted", "tag": "bacac1ae-1613-4692-89fe-53fb069eb6ad"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:17.926947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:17.932292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:17.932292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:17.939292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] Creating event network-vif-deleted:bacac1ae-1613-4692-89fe-53fb069eb6ad for instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 on hv-cinder-77957 Aug 25 03:12:17.944735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-9945bc73-3066-4b83-bbf9-485239387196 req-668de581-6617-4250-92f1-f02a0299cd83 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030858 Aug 25 03:12:17.945316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 375/728] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:18.091496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:18.092035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:18.098510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:18.099000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:18.099429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:18.100127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:18.100736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:18.101172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:18.173518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7daac509316048ec903a5d78d3586aad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a66dfea4c5492da1ac3e1f76cbe35d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:18.181727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e00b013a-8aff-4bde-b125-8a94e8661073 tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 200 len: 1307 microversion: 2.1 time: 0.095145 Aug 25 03:12:18.182323 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 354/729] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:18 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:18.291562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:18.292259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:18.304061 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:18.304590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:18.305030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:18.305745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:18.306203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:18.306756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:18.462854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:18.472801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-dea09475-98d8-46fe-99b7-1afd71eee995 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.185400 Aug 25 03:12:18.473639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 376/730] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:18 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:19.202598 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:19.203154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] [instance: bbd488ac-822f-4fe0-9a52-b283ee2bea81] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:19.210142 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:19.210624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:19.211054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:19.211742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:19.212224 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:19.212635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:19.226342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] HTTP exception thrown: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Request method failure captured: Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 HTTP/1.1 Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBucpU8RUMeS449pGN11FAVpH-9_b7FTynxGl66lliI6ZBAMCljHcZQW0qCHHttc93uqHuQRCgwvBiNil4ZTvoLjysM1QcES1CegEVnIK99jTYnhO52FsK5I-7afZxLIDszMyOWy8uuDquZI2kypGG0btXlRozOu9UC2pcKGeVUeILMQ Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:12:19.227964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/d5a66dfea4c5492da1ac3e1f76cbe35d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_d5a66dfea4c5492da1ac3e1f76cbe35d"}]}] Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: d5a66dfea4c5492da1ac3e1f76cbe35d Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1599602354 Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 7daac509316048ec903a5d78d3586aad Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1599602354-project Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. Aug 25 03:12:19.229536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'bbd488ac-822f-4fe0-9a52-b283ee2bea81'} Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:12:19.230499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. Aug 25 03:12:19.231886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:12:19.233371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] Returning 404 to user: Instance bbd488ac-822f-4fe0-9a52-b283ee2bea81 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:12:19.233371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-48fb784a-e34a-40cb-a999-8f0b588b34da tempest-ServerRescueNegativeTestJSON-1599602354 tempest-ServerRescueNegativeTestJSON-1599602354-project] 10.222.0.75 "GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81" status: 404 len: 111 microversion: 2.1 time: 0.030808 Aug 25 03:12:19.233371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 355/731] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:19 2022] GET /compute/v2.1/servers/bbd488ac-822f-4fe0-9a52-b283ee2bea81 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:12:19.494581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:19.495119 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:19.502144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:19.502680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:19.503060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:19.503808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:19.505482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:19.505632 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:19.790111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:19.799154 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-55575dc1-4a40-4c36-ae67-b2973e0e618b tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.308674 Aug 25 03:12:19.799735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 377/732] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:19 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:20.014758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:20.015550 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:20.021767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:20.022244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:20.022670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:20.023346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:20.023781 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:20.024215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:20.049219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-956631cb-9526-4b21-8474-1198b5f7cc3d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/ips" status: 200 len: 152 microversion: 2.20 time: 0.038296 Aug 25 03:12:20.050006 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 356/733] 10.222.0.75 () {60 vars in 1289 bytes} [Thu Aug 25 03:12:20 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:12:20.821881 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:20.822669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:20.825100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:20.832000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:20.834280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:20.834942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:20.835862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:20.836346 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:20.836772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:21.081801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:21.090543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-57d81af3-98d8-4af3-a951-747dca66c1e3 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.272455 Aug 25 03:12:21.091203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 378/734] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:20 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:22.111710 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:22.112384 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:22.119604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:22.123304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:22.123304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:22.123304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:22.123304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:22.123662 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:22.340216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:22.348449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-60708ab6-54e8-461b-b737-c87b5e8996db tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.240142 Aug 25 03:12:22.349012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 357/735] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:22 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:22.355519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:22.356165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:22.362974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:22.364034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:22.364546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:22.365228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:22.365670 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:22.366094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:22.388127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lazy-loading 'flavor' on Instance uuid fede0266-7f08-4740-b64d-c7900ee062d2 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:12:23.010164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-023f0d9e-c90d-4bff-b7f6-ab52c2e91467 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/action" status: 202 len: 0 microversion: 2.20 time: 0.657780 Aug 25 03:12:23.013819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 379/736] 10.222.0.75 () {62 vars in 1319 bytes} [Thu Aug 25 03:12:22 2022] POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:12:23.023556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:23.026197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:23.038419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:23.041956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:23.043935 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:23.047466 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:23.048166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:23.048765 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:23.203780 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:23.213369 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:23.214918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:23.216099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-693e3d74-d470-4b84-a942-d98725ef4697 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.197846 Aug 25 03:12:23.216681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 358/737] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:23 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:23.370298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:23.371215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:23.378634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:23.379717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:23.380782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:23.381040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:23.381507 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:23.381955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:23.528914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:23.536833 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cdbd8f08-8afb-4f30-b434-ac416cacbf13 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.171376 Aug 25 03:12:23.537610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 380/738] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:23 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:24.239783 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:24.240522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:24.247117 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:24.247605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:24.248039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:24.248767 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:24.249218 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:24.249640 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:24.557937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:24.558682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:24.565290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:24.565893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:24.566399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:24.568393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:24.568922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:24.569439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:24.630701 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:24.634385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:24.639595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:24.640951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:24.642164 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-29af3523-18cd-47b0-97e4-9f085a8dda9d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.407169 Aug 25 03:12:24.642718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 359/739] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:24 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:24.739013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:24.747153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-84ad19b2-f384-47cf-ae84-77de48740899 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.193011 Aug 25 03:12:24.747815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 381/740] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:24 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:25.670283 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:25.676719 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:25.678419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:25.678903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:25.679336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:25.680021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:25.680498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:25.680920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:25.768070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:25.768726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:25.776218 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:25.776709 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:25.777146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:25.777867 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:25.778322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:25.778747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:25.783219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:25.836506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:25.844793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:25.846362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:25.847505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e7fdb3bb-d789-404c-afbc-3227ef78d616 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.181461 Aug 25 03:12:25.848647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 360/741] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:25 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:25.917223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:25.925832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3e5ef8d0-bfeb-4dec-9b81-f12533212338 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.161482 Aug 25 03:12:25.936694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 382/742] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:25 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:26.870793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:26.871396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:26.873817 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:26.878653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:26.879509 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:26.879991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:26.880709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:26.881153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:26.881565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:26.947761 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:26.948404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:26.955367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:26.955853 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:26.956326 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:26.957124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:26.957575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:26.958273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:27.096982 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:27.101228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:27.106480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fdfd367b-0767-433a-87fe-f6d12f7d6756 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.162857 Aug 25 03:12:27.107233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 383/743] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:26 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:27.115786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:27.117332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:27.118556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-be68c81f-048d-4389-9ccc-6edd26b70933 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.251822 Aug 25 03:12:27.119282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 361/744] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:26 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:28.135018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:28.136625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:28.144505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:28.148126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:28.148448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:28.148900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:28.149000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:28.149091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:28.149091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:28.149091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:28.155099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:28.157417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:28.160030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:28.161500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:28.162161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:28.162781 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:28.337026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:28.346010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8b360a84-c153-4721-90a3-1b91cf04818c tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.214986 Aug 25 03:12:28.350180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 384/745] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:28 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:28.476309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:28.490614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:28.495109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:28.496464 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-92c06cc3-1c60-4cc3-86d2-76aaf12f2e1d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.359093 Aug 25 03:12:28.497052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 362/746] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:28 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:29.371496 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:29.373053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:29.383114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:29.383604 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:29.384040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:29.384798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:29.385243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:29.385669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:29.521566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:29.522252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:29.532701 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:29.533201 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:29.537544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:29.537544 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:29.543861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:29.544354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:29.598594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:29.607908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8341bf96-a4d9-481d-98ff-549ad4aaa583 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.242290 Aug 25 03:12:29.612391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 385/747] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:29 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:29.826075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:29.836657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:29.838944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:29.841299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5046e46f-81ba-43e6-a2da-4040f2247364 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.324864 Aug 25 03:12:29.842286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 363/748] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:29 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:30.631279 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:30.631910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:30.638527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.639003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.639436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.640118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.640628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.641056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.773309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:30.781068 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-31cb73ae-771c-42d0-9d5f-7c8d04585fbb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1508 microversion: 2.1 time: 0.154971 Aug 25 03:12:30.781634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 386/749] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:30 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:30.802336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:30.802931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:30.809867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.810413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.810883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.811561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.812022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.812451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.873334 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:30.873665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:30.883512 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.884107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.884673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.885532 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:30.886230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:30.886859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:30.973549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121255) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:12:31.069460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:31.082438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:31.084738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:31.086020 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4cc6bf2f-cf26-45a4-bfbe-446610e559cc tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.224969 Aug 25 03:12:31.086648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 387/750] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:30 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:31.343214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4d172616-246e-478b-b11c-e623bdd3a577 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "POST /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71/action" status: 202 len: 0 microversion: 2.1 time: 0.541226 Aug 25 03:12:31.343981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 364/751] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:12:30 2022] POST /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:12:31.355953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:31.356798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:31.364241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:31.366493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:31.366493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:31.366493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:31.366493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:31.366850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:31.507975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:31.515711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c7b8d172-8540-4a2d-a37f-739cc7ebf465 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1516 microversion: 2.1 time: 0.165834 Aug 25 03:12:31.516348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 388/752] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:31 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:31.799561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "name": "network-vif-unplugged", "status": "completed", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:31.814420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:31.814991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:31.815536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:31.828529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.compute.server_external_events [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] Unable to find a host for instance bb779de8-4034-4b32-a378-d65e4bbdbf71. Dropping event network-vif-unplugged {{(pid=121255) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 25 03:12:31.829699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-557b72f5-3b36-4123-9d61-86fc6fec70d3 req-3f2c89a2-4136-4b5a-ac13-f360a2672615 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.252605 Aug 25 03:12:31.830597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 365/753] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 254 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 25 03:12:32.112581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:32.113262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:32.126086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:32.127001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:32.127648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:32.128915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:32.129861 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:32.131110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:32.331274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:32.340542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:32.342036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:32.343420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-35d2a664-0bab-4991-a9a8-c70d0a513a95 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.237266 Aug 25 03:12:32.343978 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 389/754] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:32 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:32.539984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:32.540688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:32.560415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:32.561241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:32.561775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:32.562620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:32.563153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:32.563589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:32.564939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f0b98868-47d2-4146-a96a-dc2289dac40d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: .version_select at 0x7ff19b4024c0>, body: {"keypair": {"name": "tempest-keypair-1130132669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDBQLfjWBV8ku0l/OuIs6u8d0UI61i371LNrZS37i+4YVVypqomvkrWfJjG3VWaVe89p/yEx5dtnXFUCvGACkhhi1IKGfZLtOkQmn2BosS7Xsz6dUEU0KiIcSiFY2Zpxw=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:32.602215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-f0b98868-47d2-4146-a96a-dc2289dac40d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:12:32.607917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-f0b98868-47d2-4146-a96a-dc2289dac40d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:12:32.719165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f0b98868-47d2-4146-a96a-dc2289dac40d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.213010 Aug 25 03:12:32.720261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 366/755] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:12:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:32.724726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:32.732997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-dfea1954-a01f-4eed-aa33-a4c8e7ba0db9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1516 microversion: 2.1 time: 0.197868 Aug 25 03:12:32.733676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 390/756] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:32 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:33.367028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:33.367688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:33.373953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:33.374435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:33.377532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:33.377532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:33.377532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:33.377532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:33.511094 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:33.519204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:33.521526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:33.522683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bfa2bdbb-18ab-44ee-a524-40be40677f4a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.160347 Aug 25 03:12:33.523241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 367/757] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:33 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:33.754783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:33.755492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:33.762023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:33.762507 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:33.762940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:33.763640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:33.764094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:33.764593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:33.922201 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:33.931373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7af05a05-943c-4682-93d5-82201dd0a9b6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1518 microversion: 2.1 time: 0.181288 Aug 25 03:12:33.932441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 391/758] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:33 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:34.002525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:34.004851 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:34.014033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.014533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.015031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:34.015739 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.016237 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.016666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:34.042895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-dfc6bfa1-e38a-42a2-8f8d-bc4681e792d6 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/ips" status: 200 len: 143 microversion: 2.1 time: 0.052847 Aug 25 03:12:34.043483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 368/759] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:12:33 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/ips => generated 143 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:34.546260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:34.546863 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:34.553511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.554208 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.554789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:34.555670 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.556302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.556875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:34.706598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:34.714997 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:34.716605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:34.717692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c504b81d-adba-4981-b15f-801a0f1d2b1b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.175297 Aug 25 03:12:34.718243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 392/760] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:34 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:34.956355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:34.956355 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:34.967547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.967977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.969746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:34.970488 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:34.970940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:34.971364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:35.304440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:35.313367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-851d75e4-e0ef-439c-97d5-4c5628053804 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.362537 Aug 25 03:12:35.314623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 369/761] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:34 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:35.743657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:35.746240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:35.753487 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:35.754702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:35.755330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:35.756231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:35.756973 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:35.761455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:35.942616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:35.951990 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:35.954030 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:35.955432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5cb18dc6-e0ad-4f2f-bd80-f267c625aca6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.217971 Aug 25 03:12:35.962753 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 393/762] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:35 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:35.967096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca44f750-3d83-47e5-9208-2cc6bfa039ce"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:35.970262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:35.982858 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:35.987276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:35.987276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:35.987276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:35.987276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:35.987629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:35.987717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-311935044", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ca25ebd-ab9b-4352-95b3-63248390eeaa"}], "security_groups": [{"name": "tempest-securitygroup--456561152"}], "key_name": "tempest-keypair-1130132669", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:36.115371 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] validate_networks() for [('1ca25ebd-ab9b-4352-95b3-63248390eeaa', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:12:36.544364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:12:36.544792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:12:36.545264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:12:36.545673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:12:36.546083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:12:36.555157 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.555631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.556066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:36.556871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.557318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.557740 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:36.574678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:12:36.578784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:12:36.590722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:12:36.593089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:12:36.703785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7658c906-3e7a-4724-a5e3-ae704c2acc3a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.722416 Aug 25 03:12:36.708783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 394/763] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:12:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 25 03:12:36.710172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:36.711028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:36.717403 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.718103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.718546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:36.719246 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.719697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.720130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:36.859211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:36.868819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c629b3d3-c37f-4917-9119-c39c98d8e117 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.163272 Aug 25 03:12:36.869393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 395/764] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:36 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:36.876325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-743e1606-0111-4b1b-863f-d3f288bdf516 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:36.876325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-743e1606-0111-4b1b-863f-d3f288bdf516 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:36.932265 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-743e1606-0111-4b1b-863f-d3f288bdf516 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:36.939144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-743e1606-0111-4b1b-863f-d3f288bdf516 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1241 microversion: 2.1 time: 0.068822 Aug 25 03:12:36.939704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 396/765] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:36 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:36.978657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:36.979302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:36.985514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.986009 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.986628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:36.987214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:36.987672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:36.988647 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:37.023018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-edb97187-605f-41d4-8281-11a81bec99ea tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.054856 Aug 25 03:12:37.023018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 370/766] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:12:35 2022] POST /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 194 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:37.143552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:37.152066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:37.153648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:37.154808 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-58b750fe-4300-4764-8545-aba4782f612e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.180027 Aug 25 03:12:37.159961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 397/767] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:36 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:12:37.892461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:37.893147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:37.901109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:37.901109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:37.901109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:37.901610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:37.902056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:37.902478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:37.960657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8644a5c3-dc09-4fe6-a5aa-c8b2d44cafc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:37.961259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8644a5c3-dc09-4fe6-a5aa-c8b2d44cafc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:38.016918 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8644a5c3-dc09-4fe6-a5aa-c8b2d44cafc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:38.024695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8644a5c3-dc09-4fe6-a5aa-c8b2d44cafc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1241 microversion: 2.1 time: 0.068500 Aug 25 03:12:38.025264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 398/768] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:37 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:38.047182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:38.054983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-305635fb-fe27-432d-9099-af1dc5eff6f2 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.167383 Aug 25 03:12:38.055481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 371/769] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:37 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:38.177217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:38.177983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:38.184678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:38.185164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:38.185606 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:38.186296 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:38.186746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:38.187170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:38.323864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:38.333370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:38.334891 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:38.336053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3e6b1351-e74e-464f-82a0-5dda8a0873a6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.162963 Aug 25 03:12:38.336627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 399/770] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:38 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:39.046832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:39.047449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:39.054160 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.054844 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.055371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.056061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.056585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.056998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.076954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:39.077561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:39.085110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.085594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.086027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.087112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.087325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.087588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.125429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:39.135791 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a7a0e86d-d0c8-4e2c-b6aa-14b40f983540 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1293 microversion: 2.1 time: 0.092728 Aug 25 03:12:39.148855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 372/771] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:39 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:39.258911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:39.269579 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f36de322-b77f-4f82-a994-e4f74f58ffab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.195925 Aug 25 03:12:39.274845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 400/772] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:39 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:39.359442 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:39.360050 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:39.367585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.368322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.368748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.369920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:39.370374 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:39.371031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:39.643284 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:39.651743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:39.653519 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:39.654903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1ad67482-91a0-4f68-b621-6cb17bb7b831 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1746 microversion: 2.20 time: 0.299689 Aug 25 03:12:39.655455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 373/773] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:39 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1746 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:40.166071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:40.166826 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:40.173930 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.174275 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.174782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.175579 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.176241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.176817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.202782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:40.253229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:40.262338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f4c602be-6f91-4500-bbb6-3f4b74e14b6e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1299 microversion: 2.1 time: 0.100242 Aug 25 03:12:40.263502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 401/774] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:40 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:40.291818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:40.293034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:40.299531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.300115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.305173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.305173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.305173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.305173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.557308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:40.565469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-58df48a6-a666-4172-b3a1-05921b142d73 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.277609 Aug 25 03:12:40.566865 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 374/775] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:40 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:40.679979 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:40.680752 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:40.688023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.688781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.689375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.690090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:40.690547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:40.691620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:40.898799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:40.910841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:40.914837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:40.917124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f84364a2-9081-42d7-a151-a8576ada6817 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.241251 Aug 25 03:12:40.917804 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 402/776] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:40 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:12:41.294194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:41.294823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:41.306235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.306774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.307236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.307945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.308422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.309115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.451241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "name": "network-vif-plugged", "status": "completed", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:41.461500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.462171 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.462795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.476729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] Creating event network-vif-plugged:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:12:41.482816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-94ff34e2-72a4-4c3d-9f7d-50b356d80fc7 req-5d1e448f-32c3-4b6a-8a36-b74b2fc6367a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035483 Aug 25 03:12:41.489408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 403/777] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:41.538864 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:41.546749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-44d232cf-9864-4282-9bfd-bc8be47a1169 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.260965 Aug 25 03:12:41.574303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 375/778] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:41 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:41.590141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:41.590832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:41.613782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.614432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.614893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.619695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.620211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.621370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.856391 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:41.865197 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-92ad0ff0-c95a-4a7f-98fe-fad6ac965e88 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.279325 Aug 25 03:12:41.879731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 404/779] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:41 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:41.947637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:41.948740 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:41.960511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.961439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.962319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.963236 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:41.963888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:41.964511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:41.969141 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:42.017419 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16", "tag": "bcaf3694-63cd-4684-9f00-b8a2d1bf1789"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:42.048375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:42.049017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:42.049471 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:42.074986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] Creating event network-changed:bcaf3694-63cd-4684-9f00-b8a2d1bf1789 for instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 on hv-cinder-77957 Aug 25 03:12:42.080471 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-3bede42c-2cda-4bcd-bc29-4a6d5de5459a req-1dc86d99-9d21-454e-b3f9-9026ac7db8e1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066565 Aug 25 03:12:42.081075 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 405/780] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:42.321853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:42.334265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:42.337325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:42.339471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2473a937-0aa1-4d9c-a54a-2c8a1c0f96ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.395673 Aug 25 03:12:42.340496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 376/781] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:41 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:42.570113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.570819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:42.584282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:42.589994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:42.590652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:42.591556 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:42.592936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:42.593358 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:42.810513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:42.819590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0087f77f-476a-466e-a451-a3c3e13c29fa tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.254169 Aug 25 03:12:42.821711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 406/782] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:42 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:42.887385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:42.887983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:42.890209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:42.897176 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:42.898524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:42.899306 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:42.900302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:42.900951 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:42.901474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:43.192019 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:43.202227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-55b72992-e59b-492d-a836-c307110c8b11 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.318437 Aug 25 03:12:43.217822 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 377/783] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:42 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:43.366107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.370327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:43.376535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:43.377036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:43.377526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:43.381045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:43.381694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:43.382288 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:43.548053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:43.557799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:43.559540 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:43.560968 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d61d9df9-8c97-47a0-b0f5-cd9e5393d8c9 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.198765 Aug 25 03:12:43.561878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 407/784] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:43.842165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:43.842759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:43.864886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:43.865665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:43.869169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:43.870412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:43.871115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:43.871695 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:44.127527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:44.140741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e8cf0243-c484-47f5-a36a-fa63fef6ce0c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.302412 Aug 25 03:12:44.156826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 378/785] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:43 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:44.227878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:44.229341 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:44.237568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:44.238989 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:44.239685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:44.241052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:44.241581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:44.242091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:44.401220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:44.409180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cd93ad78-13b2-46b5-b4bf-ea3c9b5afeb5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.185450 Aug 25 03:12:44.426921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 408/786] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:44 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:44.587068 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:44.587693 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:44.600247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:44.600761 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:44.605732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:44.606595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:44.607426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:44.608035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:44.785941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:44.794764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:44.796290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:44.797454 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d5500bf8-f9fa-499d-9079-598286af51b8 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.214989 Aug 25 03:12:44.798326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 379/787] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:44 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:45.167483 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.168174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:45.174375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.174878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.176040 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.176914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.177407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.177840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.320423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:45.330213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e745a9de-51db-44f1-b031-ef6bfc2a28b2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.166335 Aug 25 03:12:45.331307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 409/788] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:45.431103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.431739 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:45.438536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.439046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.439470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.440177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.440623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.441120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.579916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:45.586733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "name": "network-vif-plugged", "status": "completed", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:45.589081 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-96de7372-2f33-47c3-b585-3a274b372e91 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.161832 Aug 25 03:12:45.589668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 380/789] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:45.597792 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.598780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.599220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.611866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] Creating event network-vif-plugged:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:12:45.617285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-4886ef30-20bf-448e-b915-6b83be301da1 req-d9bfca22-7386-45de-ae82-13cea1aa239d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Aug 25 03:12:45.617892 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 410/790] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:45.821279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.821878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:45.828713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.833025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.833025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.833025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.833025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.833490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.939953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.943042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:45.949137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.949581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.950010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.950697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:45.951139 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:45.951555 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:45.986182 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-87182d60-5338-415b-ad69-119ddd8a28d3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050493 Aug 25 03:12:45.986950 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:45.987102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 411/791] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:45.997501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:45.997909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:45.998380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:45.999126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:46.000575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-69ee8a80-d293-4523-90f8-8d3273276a28 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.183105 Aug 25 03:12:46.001135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 381/792] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:46.005548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.006029 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.006538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.007226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.007669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.008085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.041463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9d3bd331-4ccd-4c08-83fd-e1ccd7a8e337 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce" status: 200 len: 194 microversion: 2.1 time: 0.047498 Aug 25 03:12:46.042085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 412/793] 10.222.0.75 () {58 vars in 1413 bytes} [Thu Aug 25 03:12:45 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:46.352566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:46.353075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:46.359813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.361427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.361868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.362596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.363083 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.363502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.529188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:46.538977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8bd30899-31f5-4c74-b23e-ca604af41406 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.190226 Aug 25 03:12:46.567099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 382/794] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:46 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:46.619101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:46.619101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:46.619101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:46.621613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.622713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.623534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.624879 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:46.625764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:46.626742 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:46.799579 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:46.807885 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c8615f7d-6e36-4d0a-afaf-c8661a280ee6 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.200722 Aug 25 03:12:46.809084 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 413/795] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:46 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:47.024707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:47.025538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:47.032564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.033311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.034010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:47.034868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.035428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.035953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:47.206026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:47.236420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:47.236420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:47.236420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3f9a9c33-3356-49e2-b4b3-86fec53f4dbe tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.196934 Aug 25 03:12:47.236805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 383/796] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:47 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:47.560729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:47.562064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:47.569411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.569898 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.570521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:47.571226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.571678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.572100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:47.719392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:47.728618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5bd31b46-3b72-455c-a2cb-eda1db768be8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.172310 Aug 25 03:12:47.729306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 414/797] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:47 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:47.832338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:47.833213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:47.839981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.840493 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.841102 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:47.841969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:47.842419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:47.842835 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:48.006871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:48.015679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e74bf660-2a21-495c-8817-cb6c07826ebf tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.189801 Aug 25 03:12:48.028173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 384/798] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:47 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:48.242478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:48.243499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:48.249615 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=10 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:48.251243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:48.251718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:48.252159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:48.252856 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:48.253413 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:48.254144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:48.404819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:48.416665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:48.418521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:48.419852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6e16e434-0dde-4baf-8c9e-25c1f2db041d tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.182667 Aug 25 03:12:48.420612 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 415/799] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:48 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:48.751219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:48.751741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:48.757986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:48.758461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:48.758888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:48.759624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:48.760082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:48.760525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:48.890425 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:48.900219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e77f9c68-574f-40e4-8c0e-317b34726f0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.153014 Aug 25 03:12:48.900898 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 385/800] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:48 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:49.038846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:49.039384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:49.045754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.046225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.046764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.047442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.053393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.053915 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.189920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:49.197691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-587966e2-21cf-42df-98df-30cd0f8bf0e9 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1574 microversion: 2.1 time: 0.163352 Aug 25 03:12:49.198266 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 416/801] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:49 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:49.443614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:49.444230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:49.450217 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.450699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.451130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.451812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.452289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.452708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.582221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16", "name": "network-vif-plugged", "status": "completed", "tag": "bcaf3694-63cd-4684-9f00-b8a2d1bf1789"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:49.600957 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.603981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.603981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.617899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:49.619266 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] Creating event network-vif-plugged:bcaf3694-63cd-4684-9f00-b8a2d1bf1789 for instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 on hv-cinder-77957 Aug 25 03:12:49.625243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-b70cdd32-6b14-4c74-8852-7dbdb8f8c313 req-12255e62-66b1-46b3-8490-e1b5e73456d8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046984 Aug 25 03:12:49.626086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 417/802] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:12:49.629392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:49.631112 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:49.632437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-be18f2d2-ba5b-4992-a534-dd5a88014972 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.193183 Aug 25 03:12:49.648173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 386/803] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:49 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:49.922323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:49.923046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:49.925703 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:49.934291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.934419 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.934783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:49.935509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:49.936179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:49.936609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.088406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:50.098087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4d976025-e39d-4aa5-802f-ef3e851b5590 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.180160 Aug 25 03:12:50.098813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 418/804] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:49 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:50.203098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89a09a68-ef06-4fa6-872a-26c60959cfb6"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:50.206221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:50.219449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.220126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.220790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.221651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.223002 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.223476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.236996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:50.238550 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:50.255603 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.275926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.275926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.275926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.275926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.276639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.517852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:50.527104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4bdffb90-95b7-47d2-9512-333d50f5e262 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1561 microversion: 2.1 time: 0.297384 Aug 25 03:12:50.542500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 419/805] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:50 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1561 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:50.657887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:50.658811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:50.665970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.666509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.666951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.667716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:50.668187 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:50.668640 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:50.829444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:50.839607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=100 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:50.845363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:50.847459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:50.848860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cae47e99-3a8a-4029-b35f-b457df4a2a42 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.196268 Aug 25 03:12:50.849696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 420/806] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:50 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:12:51.119253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:51.120899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:51.127844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:51.129189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:51.129617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:51.130375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:51.130823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:51.131247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:51.299845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:51.299845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-703c5e97-edd8-4d78-adfd-4f199c7f0f20 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.180265 Aug 25 03:12:51.299845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 421/807] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:51 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:51.676325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-434fbcfc-0882-414a-845f-81886c85170d tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "POST /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477656 Aug 25 03:12:51.693496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 387/808] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:12:50 2022] POST /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 194 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:51.877586 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:51.878242 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:51.890738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:51.891840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:51.893250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:51.894087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:51.894827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:51.895264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:52.062777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:52.076034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:52.077685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:52.078953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0872f7e3-9961-4be6-b8e8-b51e3b43d784 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.205340 Aug 25 03:12:52.079841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 422/809] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:51 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:52.318826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:52.319536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:52.326416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:52.326912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:52.327349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:52.328103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:52.328585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:52.329014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:52.486855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:52.496878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d4cc7ad9-7c3d-4ad0-9c01-26d7f26191e5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.183114 Aug 25 03:12:52.497464 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 388/810] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:52 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:53.105188 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:53.105791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:53.112118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:53.112716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:53.113349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:53.114039 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:53.114493 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:53.114924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:53.249565 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:53.258160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:53.259648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:53.260809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2183c138-a4ac-4606-9b0f-9786c9ab3b13 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.159595 Aug 25 03:12:53.261364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 423/811] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:53 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:53.518491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:53.519707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:53.526006 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:53.526483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:53.526937 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:53.527642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:53.528228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:53.528643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:53.669712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:53.678246 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-83364506-5097-4b21-be5d-37c5d0cbf2ac tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.163630 Aug 25 03:12:53.691371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 389/812] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:53 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:54.284056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:54.285339 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:54.292080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:54.292593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:54.293022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:54.293706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:54.294155 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:54.294576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:54.431583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:54.440008 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:54.441745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:54.442895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ec36d6e9-ced4-4624-9b38-c8394e0ad277 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.162875 Aug 25 03:12:54.443445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 424/813] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:54 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:54.699012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:54.699603 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:54.706026 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:54.707289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:54.707724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:54.708429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:54.708883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:54.709304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:54.864114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:54.871760 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f81d08e8-775f-465a-95f0-14c75dffef86 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1366 microversion: 2.1 time: 0.176793 Aug 25 03:12:54.872358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 390/814] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:54 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:12:55.465058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:55.465770 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:55.472990 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:55.473471 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:55.473907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:55.475299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:55.475760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:55.476716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:55.621404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:55.630439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:55.634178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:55.634178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7e384d24-75b5-4de8-806d-5868f6fe0deb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1741 microversion: 2.20 time: 0.172114 Aug 25 03:12:55.634178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 425/815] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:55 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:55.893309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:55.894521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:55.901896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:55.902385 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:55.902817 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:55.903521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:55.903969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:55.904414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:55.926516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:56.147392 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:56.155084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2e658137-73fe-4ffd-b895-25f4a4d10de5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1557 microversion: 2.1 time: 0.265716 Aug 25 03:12:56.155645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 391/816] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:12:55 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1557 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:12:56.174960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:56.175536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:56.181534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:56.182006 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:56.182432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:56.183112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:56.183552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:56.183969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:56.264992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-68f06194-86e5-43e0-a273-ba013d719a90 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093799 Aug 25 03:12:56.265582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 426/817] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:12:56 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:56.656073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:56.656798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:56.663031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:56.663534 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:56.664013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:56.664786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:56.665441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:56.667311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:56.798048 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:56.806957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:56.808477 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:56.809620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bffee54e-1930-4701-9d54-d910b281e6ae tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1723 microversion: 2.20 time: 0.157757 Aug 25 03:12:56.810182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 392/818] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:56 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:57.502375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16", "tag": "bcaf3694-63cd-4684-9f00-b8a2d1bf1789"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:57.513183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:57.513988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:57.514525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:57.528502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] Creating event network-changed:bcaf3694-63cd-4684-9f00-b8a2d1bf1789 for instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 on hv-cinder-77957 Aug 25 03:12:57.533534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-84835762-5615-4f00-a53b-7097e9272abe req-8d1d19d9-796e-4d63-84e3-f645232b05b5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035685 Aug 25 03:12:57.535058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 427/819] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:12:57.833525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:57.834114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:57.840655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:57.841137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:57.841566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:57.842256 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:57.842704 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:57.843124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:57.973916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:57.982119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:57.983596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:57.984770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ddde5c17-fb1d-4956-a03f-86454d0dfcc3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1723 microversion: 2.20 time: 0.155912 Aug 25 03:12:57.985327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 393/820] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:57 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:12:59.009189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:12:59.009906 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:12:59.016210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:59.016903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:59.017333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:59.018014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:59.019146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:59.019570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:59.159642 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:59.168376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:59.169992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:12:59.171200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4f71010f-f274-4926-aee5-e869598e3b48 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1723 microversion: 2.20 time: 0.167177 Aug 25 03:12:59.171815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 428/821] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:12:59 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:12:59.429169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "name": "network-vif-unplugged", "status": "completed", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:12:59.435104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:59.440090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:12:59.442456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:12:59.442456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:12:59.453133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] Creating event network-vif-unplugged:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:12:59.458872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-a36a906f-11b7-4da3-ad9d-87707b2f86fa req-46443653-be82-4a9d-81a6-badfb327f708 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033495 Aug 25 03:12:59.459455 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 394/822] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:00.194202 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:00.194975 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:00.201407 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:00.201890 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:00.202319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:00.203014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:00.203844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:00.204302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:00.354382 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:00.362927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:00.364597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:00.365780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-55b29c87-38a9-4fcd-92ae-a6d8d5a0c822 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1723 microversion: 2.20 time: 0.175894 Aug 25 03:13:00.366350 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 429/823] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:00 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:01.389634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:01.390325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:01.397692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:01.398171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:01.398604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:01.399325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:01.400014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:01.400473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:01.531684 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:01.540975 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:01.542551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:01.543775 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bf4ca36e-8900-4e17-9951-d9509ca608a7 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1726 microversion: 2.20 time: 0.158942 Aug 25 03:13:01.544375 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 395/824] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:01 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:01.567660 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac6b9f8c-707e-4ce0-b784-6a03a5ca236c"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:01.570021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:01.576408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:01.576895 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:01.577357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:01.578054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:01.578506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:01.578928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:02.896936 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-01c4ac05-9b84-412b-ab63-26331181bac2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.334100 Aug 25 03:13:02.897589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 430/825] 10.222.0.75 () {62 vars in 1364 bytes} [Thu Aug 25 03:13:01 2022] POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments => generated 188 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 25 03:13:03.027607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:03.028091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:03.034738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.035339 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.035776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.036501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.036952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.037374 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.488394 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:03.490614 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:03.496598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.497089 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.499777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.499777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.499777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.499777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.531247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-dc52f961-4027-43f5-8922-21df3feafcd5 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047462 Aug 25 03:13:03.531844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 431/826] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:13:03 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:13:03.672785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:03.673264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:03.680410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.680882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.681307 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.681984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.682426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.682843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.711628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3481b506-8211-4837-b4e5-04e830127bfc tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce" status: 200 len: 194 microversion: 2.1 time: 0.043124 Aug 25 03:13:03.712224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 432/827] 10.222.0.75 () {58 vars in 1413 bytes} [Thu Aug 25 03:13:03 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:13:03.723054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:03.723682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:03.729478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.729951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.730380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.731059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.731546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.731961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.813293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lazy-loading 'services' on Instance uuid c844d8f2-8bd9-404d-81ec-6f829ab49551 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:13:03.910563 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0f89c2de-4307-4877-abbd-a6f8329e216a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments/ac6b9f8c-707e-4ce0-b784-6a03a5ca236c" status: 202 len: 0 microversion: 2.20 time: 0.887149 Aug 25 03:13:03.911090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 396/828] 10.222.0.75 () {60 vars in 1457 bytes} [Thu Aug 25 03:13:03 2022] DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments/ac6b9f8c-707e-4ce0-b784-6a03a5ca236c => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:13:03.971920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:03.972792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:03.978692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.979168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.979594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:03.980358 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:03.980840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:03.981259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:04.011072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121255) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 25 03:13:04.131582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f6109265-7238-4cbd-ac10-6b0a8fb6c89a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce" status: 202 len: 0 microversion: 2.1 time: 0.412980 Aug 25 03:13:04.132361 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 433/829] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:13:03 2022] DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/ca44f750-3d83-47e5-9208-2cc6bfa039ce => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:13:04.462853 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ea166714-59fd-40f0-b1e6-94442e2caeb4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/action" status: 202 len: 0 microversion: 2.20 time: 0.495344 Aug 25 03:13:04.463407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 397/830] 10.222.0.75 () {62 vars in 1319 bytes} [Thu Aug 25 03:13:03 2022] POST /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 25 03:13:04.472470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:04.473276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:04.479316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:04.479796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:04.480454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:04.481189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:04.481644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:04.482065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:04.624320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:04.633706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:04.635320 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:04.636558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-53b35977-86e5-4ccc-8a7f-3432dfc6f32e tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1674 microversion: 2.20 time: 0.168823 Aug 25 03:13:04.637117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 434/831] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:04 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:05.661719 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:05.662457 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:05.671036 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:05.671622 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:05.672050 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:05.672792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:05.673233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:05.673646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:05.827941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:05.836814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:05.838308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:05.840725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-03842ac0-497f-44be-ab42-eeded718ea2c tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1674 microversion: 2.20 time: 0.182383 Aug 25 03:13:05.840725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 398/832] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:05 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:06.327707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:06.328402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:06.342003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.342003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.342003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:06.342003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.342360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.342360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:06.343243 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:06.370321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-866ed563-48d9-4595-9113-90848db19083 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/89a09a68-ef06-4fa6-872a-26c60959cfb6" status: 200 len: 194 microversion: 2.1 time: 0.046561 Aug 25 03:13:06.370999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 435/833] 10.222.0.75 () {58 vars in 1413 bytes} [Thu Aug 25 03:13:06 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/89a09a68-ef06-4fa6-872a-26c60959cfb6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:06.382035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:06.382515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:06.388427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.389108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.389542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:06.392895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.392895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.392895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:06.478016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lazy-loading 'services' on Instance uuid c844d8f2-8bd9-404d-81ec-6f829ab49551 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:13:06.727280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b7a04ea1-8f3a-4897-8faf-13b6dbea46e1 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/89a09a68-ef06-4fa6-872a-26c60959cfb6" status: 202 len: 0 microversion: 2.1 time: 0.349138 Aug 25 03:13:06.728061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 399/834] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:13:06 2022] DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments/89a09a68-ef06-4fa6-872a-26c60959cfb6 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:13:06.863535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:06.864506 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:06.871848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.872664 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.873284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:06.874441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:06.875062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:06.875644 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:07.029462 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:07.041947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:07.044052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:07.045713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9744db8e-c3b9-4f99-aa82-17b3aea8e9c0 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.186711 Aug 25 03:13:07.046464 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 436/835] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:06 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:08.074680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:08.075933 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:08.082211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:08.082702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:08.083125 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:08.083809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:08.084286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:08.084708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:08.221940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:08.230066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:08.231557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:08.232738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d280bcd1-b22c-48ff-b44f-87f16135bff4 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.162841 Aug 25 03:13:08.233317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 400/836] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:08 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:08.964286 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:08.966529 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:08.974794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:08.975526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:08.976267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:08.976878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:08.977325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:08.977941 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.011026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-162ca315-22c5-4e53-b286-6581ef9e3645 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050967 Aug 25 03:13:09.012206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 437/837] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:13:08 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:13:09.126161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:09.130075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:09.136827 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.137299 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.137722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.138411 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.138852 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.139263 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.170952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c9cd31d9-a459-4e4b-9582-b1b15eb12ac7 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048813 Aug 25 03:13:09.171715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 401/838] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:13:09 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:13:09.235634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:09.236132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:09.243591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.244081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.244582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.269014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.269014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.269014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.269290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:09.269290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:09.269290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.269290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.269581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.269581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.269581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.269581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.273702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:13:09.426326 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:09.435328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:09.436993 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:09.438334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-12512187-8155-41be-b7a5-a6625481e6ce tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.186122 Aug 25 03:13:09.438896 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 402/839] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:09 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:13:09.588839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-09df9fa0-7e7e-43cb-a9ec-c443cd55260e tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 204 len: 0 microversion: 2.1 time: 0.357368 Aug 25 03:13:09.589450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 438/840] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:13:09 2022] DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:13:09.598743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:09.599711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:09.606108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.606592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.607024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.607886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:09.608524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:09.608946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:09.755708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:09.764170 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-66204c5c-61ce-4c8b-9f9f-e3903d739918 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.170115 Aug 25 03:13:09.764845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 403/841] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:09 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:10.463426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:10.464117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:10.470572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:10.471052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:10.471480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:10.472297 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:10.472749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:10.473169 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:10.618454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:10.627241 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:10.629314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:10.630689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7636e5d0-e5eb-42c5-b1c1-666ae411346f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.171599 Aug 25 03:13:10.631250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 439/842] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:10 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:10.787235 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:10.787793 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:10.794346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:10.794823 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:10.795251 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:10.795938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:10.796404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:10.796819 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:10.952501 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:10.954881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:10.962976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f78627b5-d883-419e-a2eb-63fa3b1e6277 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.180347 Aug 25 03:13:10.963676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 404/843] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:10 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:11.654146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:11.654885 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:11.662001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:11.662481 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:11.662907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:11.663596 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:11.664042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:11.664827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:11.801962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:11.811905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:11.813670 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:11.814861 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7ed360ba-9990-4f57-b66d-6eff5c302b0b tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.164782 Aug 25 03:13:11.816096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 440/844] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:11 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:11.986321 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:11.987220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:11.994627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:11.995112 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:11.995542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:11.996269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:11.996722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:11.997140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:12.141367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:12.149900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f6c54ad3-1eee-4bf2-848d-122f345b38c3 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.167727 Aug 25 03:13:12.150686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 405/845] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:11 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:12.838893 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:12.839568 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:12.847757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:12.848268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:12.848706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:12.849404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:12.849845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:12.850263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:12.989922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:12.998418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:13.000253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:13.001415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b6af7f1f-56b9-43d1-a6fc-7604b35d1d00 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.166596 Aug 25 03:13:13.019048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 441/846] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:12 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:13.172932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:13.173701 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:13.181096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:13.181679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:13.182114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:13.182811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:13.183261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:13.183843 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:13.325330 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:13.333928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3b1d58dd-2d71-4e73-90ef-5be5b90861fa tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.164801 Aug 25 03:13:13.334512 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 406/847] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:13 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:14.041501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:14.041501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:14.047951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:14.048457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:14.048882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:14.049710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:14.050257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:14.050689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:14.192748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:14.201631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:14.221132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:14.221132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cb0f7c65-a8db-47d7-9271-da23d3970e24 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.167369 Aug 25 03:13:14.221132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 442/848] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:14 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:13:14.357878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:14.358456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:14.365334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:14.365813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:14.366242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:14.366925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:14.367376 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:14.367789 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:14.526886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:14.539515 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c2f4fb83-d4c4-485e-9140-c6ec50bd4d4c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.185833 Aug 25 03:13:14.541155 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 407/849] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:14 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:15.232025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:15.232656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:15.240269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:15.240763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:15.241191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:15.241896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:15.242342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:15.242766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:15.398574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:15.407450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:15.409841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:15.411012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a356e48a-bb6e-4150-9bd5-aab6a29cfc61 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.186158 Aug 25 03:13:15.411598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 443/850] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:15 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:15.597866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:15.598486 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:15.605571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:15.606045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:15.606469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:15.607159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:15.607604 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:15.608022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:15.750406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:15.759497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7a906b8f-05d3-4103-97e0-e895abe8c87f tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.166028 Aug 25 03:13:15.763444 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 408/851] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:15 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:16.433914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:16.434553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:16.441308 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:16.441796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:16.442227 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:16.442929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:16.443521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:16.443799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:16.582260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:16.591256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:16.592828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:16.593993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-041dbc88-bbfa-4949-81df-0f7f23826b93 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.164025 Aug 25 03:13:16.594556 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 444/852] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:16 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:16.782562 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:16.783159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:16.790833 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:16.791322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:16.791754 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:16.792472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:16.792920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:16.793336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:16.933277 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:16.941156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-bc966c3c-fd54-4856-917e-296857e6845a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.162454 Aug 25 03:13:16.941820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 409/853] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:16 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:17.617306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:17.617913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:17.624277 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:17.624754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:17.625185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:17.625866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:17.626310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:17.626726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:17.757972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:17.766651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:17.768268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:17.769405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ce52e315-0a44-4da4-8bb3-0642878044c5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.156170 Aug 25 03:13:17.769961 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 445/854] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:17 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:13:17.962305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:17.962923 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:17.969427 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:17.969902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:17.970325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:17.971497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:17.971939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:17.972464 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:18.109659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:18.117972 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e5d898f7-485a-484f-bc4c-2959d8110472 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.159471 Aug 25 03:13:18.118542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 410/855] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:17 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:18.791923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:18.792563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:18.799593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:18.800096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:18.800572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:18.801258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:18.801708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:18.802129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:18.933439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:18.942673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:18.944177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:18.945322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f915371a-ed5d-4a9f-b436-ef74b67a65f5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.157308 Aug 25 03:13:18.945878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 446/856] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:18 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:19.139422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:19.140016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:19.146711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:19.147183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:19.147610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:19.148319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:19.148764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:19.149181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:19.280824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:19.288680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cf88abcb-1967-4559-bf44-710262e8859c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.153141 Aug 25 03:13:19.289256 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 411/857] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:19 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:19.968059 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:19.968713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:19.975593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:19.976071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:19.976534 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:19.977222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:19.977669 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:19.978091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:20.106126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:20.115000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:20.116622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:20.120271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e810a7eb-1093-480b-bb45-cdbc25fcc6cb tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.153568 Aug 25 03:13:20.120271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 447/858] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:19 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:20.309568 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:20.310173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:20.316599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:20.317076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:20.317504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:20.318182 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:20.318656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:20.319079 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:20.489989 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:20.497709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-807c7882-ca22-4514-aa85-062ceaebe592 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1670 microversion: 2.1 time: 0.192004 Aug 25 03:13:20.498280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 412/859] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:20 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:21.140767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:21.141352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:21.144372 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:21.148960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:21.149438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:21.149862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:21.150548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:21.150989 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:21.151406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:21.291931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:21.301798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:21.303298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:21.304617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-42d29c50-34ae-4207-8754-8d0d4ecdc847 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.167685 Aug 25 03:13:21.305176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 448/860] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:21 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:21.523831 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:21.523831 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:21.527953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:21.528622 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:21.529064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:21.529762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:21.530213 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:21.530627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:21.561032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c844d8f2-8bd9-404d-81ec-6f829ab49551", "name": "network-vif-deleted", "tag": "8931bd40-0fa3-4f84-acad-d8230437317d"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:21.572971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:21.573442 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:21.573868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:21.586080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] Creating event network-vif-deleted:8931bd40-0fa3-4f84-acad-d8230437317d for instance c844d8f2-8bd9-404d-81ec-6f829ab49551 on hv-cinder-77957 Aug 25 03:13:21.591399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-5eda68c6-d5f9-4b57-be95-7b0c773d1f00 req-4c8380fd-097e-4f4a-9501-6778342da51d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035763 Aug 25 03:13:21.592180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 449/861] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:13:21.617610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:21.627754 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b9c4dea9-21e7-4716-9229-8fae1f901bb8 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1602 microversion: 2.1 time: 0.112254 Aug 25 03:13:21.628582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 413/862] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:21 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1602 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:22.328613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:22.329321 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:22.346651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:22.347254 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:22.347921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:22.348658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:22.349274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:22.349766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:22.494754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:22.499665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:22.510082 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:22.519473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:22.519473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3fd058f9-0021-4141-8e06-948ee05e5ad2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.189869 Aug 25 03:13:22.519473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 450/863] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:22 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:22.651041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:22.652602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:22.661381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:22.661973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:22.662539 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:22.663473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:22.663996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:22.664513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:22.698503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:22.699031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:22.699468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:22.699909 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lazy-loading 'fault' on Instance uuid c844d8f2-8bd9-404d-81ec-6f829ab49551 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:13:22.755566 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '804df9333a474723968f97eb9d6bfc69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f626c34f12fb4bdab6bd42b05b79742a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:22.762818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-957f88d3-b4b9-425c-bbc5-44625ef64002 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 200 len: 1326 microversion: 2.1 time: 0.115786 Aug 25 03:13:22.763400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 414/864] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:22 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:23.537602 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:23.538234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:23.544931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:23.545411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:23.545841 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:23.546530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:23.546976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:23.547396 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:23.680921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:23.691309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:23.692993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:23.694160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-747bbec9-59f9-4b82-91db-aff9fdfbf42f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.160794 Aug 25 03:13:23.694728 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 451/865] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:23 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:23.785151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:23.785677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:23.792104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:23.792609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:23.793037 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:23.793867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:23.794313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:23.794730 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:23.809404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 HTTP/1.1 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:13:23.811135 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:23.816561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'c844d8f2-8bd9-404d-81ec-6f829ab49551'} Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:13:23.817447 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:23.818927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:23.820163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:13:23.820163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-15e0246f-bc89-41d5-834c-af0289f6456c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 404 len: 111 microversion: 2.1 time: 0.031452 Aug 25 03:13:23.820163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 415/866] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:23 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:13:23.822547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-746e89b0-74f1-4568-9119-ccf38879ca33 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '.version_select at 0x7ff19b37cd30>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:23.945739 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-746e89b0-74f1-4568-9119-ccf38879ca33 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198985181" status: 202 len: 0 microversion: 2.1 time: 0.126776 Aug 25 03:13:23.947969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 452/867] 10.222.0.75 () {58 vars in 1218 bytes} [Thu Aug 25 03:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198985181 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:13:24.719134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:24.719846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:24.740253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:24.740253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:24.740253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:24.740253 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:24.740674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:24.740674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:24.864209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:24.872659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:24.874424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:24.875619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1a4b9463-4761-4162-a817-d394fa0ee141 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.160635 Aug 25 03:13:24.876407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 416/868] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:24 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:25.637584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "name": "network-vif-plugged", "status": "completed", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:25.648300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:25.648778 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:25.649200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:25.660073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] Creating event network-vif-plugged:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:13:25.664788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-c5381e1a-52cf-4dfc-8db9-a6656fb4eb78 req-fc26f90e-43cf-435c-b0cd-fc16a872afcd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031000 Aug 25 03:13:25.665482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 453/869] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:25.899278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:25.899870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:25.906229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:25.906702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:25.907133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:25.907925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:25.908972 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:25.913482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:26.070902 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:26.080494 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:26.084465 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:26.085999 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1ab162ad-7612-43e3-bb14-177aa1750873 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.190341 Aug 25 03:13:26.086507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 417/870] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:25 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:27.112260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:27.112948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:27.119390 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.119864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.120334 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.121013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.121457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.121954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.257862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:27.266188 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:27.268331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:27.269476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-227050d1-1ab8-49f9-8a42-8ae080c6601f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.162971 Aug 25 03:13:27.270026 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 454/871] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:27 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:27.520832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:27.521328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:27.528756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.529242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.529669 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.530398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.530842 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.531262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.545650 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 HTTP/1.1 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:13:27.547205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.548764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'c844d8f2-8bd9-404d-81ec-6f829ab49551'} Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:13:27.549758 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.551270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.552936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:13:27.552936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9b9e2209-d865-44eb-8d69-87e39302f54a tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 404 len: 111 microversion: 2.1 time: 0.033187 Aug 25 03:13:27.552936 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 418/872] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:13:27 2022] DELETE /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:13:27.557347 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:27.557947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: c844d8f2-8bd9-404d-81ec-6f829ab49551] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:27.563894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.564717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.565159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.565842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:27.566318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:27.566740 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:27.579823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 HTTP/1.1 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:13:27.582163 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.583655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'c844d8f2-8bd9-404d-81ec-6f829ab49551'} Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:13:27.584661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. Aug 25 03:13:27.585866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:27.587124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance c844d8f2-8bd9-404d-81ec-6f829ab49551 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:13:27.587124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-91d6cbab-770e-4a0e-854e-1cc8c29bcd7c tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551" status: 404 len: 111 microversion: 2.1 time: 0.030033 Aug 25 03:13:27.587124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 455/873] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:27 2022] GET /compute/v2.1/servers/c844d8f2-8bd9-404d-81ec-6f829ab49551 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:13:28.292911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:28.293516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:28.301716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.302229 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.302655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.303343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.303782 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.304298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.438193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:28.446841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:28.448364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:28.449565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-58a98a38-ed44-4dfc-88c3-3c47f36499fd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1732 microversion: 2.20 time: 0.160587 Aug 25 03:13:28.450188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 419/874] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:28 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:28.939144 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:28.940272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:28.946825 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.947337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.947769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.948486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.948931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.951459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.963221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 HTTP/1.1 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:13:28.964782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.966319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '832b5cf4-2011-4790-8c89-e4078b8cf262'} Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:13:28.967146 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.968590 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:13:28.970034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:13:28.970034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1d068416-e937-49c1-91f2-da2384225089 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 404 len: 111 microversion: 2.1 time: 0.030907 Aug 25 03:13:28.970034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 456/875] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:13:28 2022] DELETE /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:13:28.975075 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:28.975670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] [instance: 832b5cf4-2011-4790-8c89-e4078b8cf262] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:28.981992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.982460 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.982891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.983550 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:28.983990 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:28.984434 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:28.997435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] HTTP exception thrown: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Request method failure captured: Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 HTTP/1.1 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuctLibo2TuhJ6XvVgS8HNkjEFWCt521h-dVW2pPTN7gbGixn6pus4yZzK56gOTFsgW0S3_z-IbHellyOf3poCPPdGAQXmszFpQ_s5kqoR1C7VWJNUg1cLY1GikYxpHn5dI4Wa2b6Hv_kv98qeY4VnIU91RkW4JwovQpQ9FNl36dKL4 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:13:28.999181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/f626c34f12fb4bdab6bd42b05b79742a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_f626c34f12fb4bdab6bd42b05b79742a"}]}] Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: f626c34f12fb4bdab6bd42b05b79742a Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeTestJSON-632408030 Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 804df9333a474723968f97eb9d6bfc69 Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeTestJSON-632408030-project Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:29.000736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '832b5cf4-2011-4790-8c89-e4078b8cf262'} Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:13:29.001592 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. Aug 25 03:13:29.003595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:13:29.005039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] Returning 404 to user: Instance 832b5cf4-2011-4790-8c89-e4078b8cf262 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:13:29.005039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c968a55f-e0eb-48e3-af0d-13497c977aa0 tempest-AttachVolumeTestJSON-632408030 tempest-AttachVolumeTestJSON-632408030-project] 10.222.0.75 "GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262" status: 404 len: 111 microversion: 2.1 time: 0.029861 Aug 25 03:13:29.005039 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 420/876] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:28 2022] GET /compute/v2.1/servers/832b5cf4-2011-4790-8c89-e4078b8cf262 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:13:29.472619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:29.473225 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:29.479536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:29.480023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:29.480497 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:29.481195 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:29.481642 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:29.482064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:29.629418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:29.637934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:29.639420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:29.640595 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bd13b1c5-8c98-4a8e-9e06-b88247c8f391 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1719 microversion: 2.20 time: 0.172127 Aug 25 03:13:29.641339 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 457/877] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:13:29 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:13:33.616960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:33.620291 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:33.622712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:33.628350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:33.628824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:33.629252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:33.629931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:33.630373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:33.630792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:33.655083 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6ec1aa93-628a-410b-b89c-fd55ed24b04e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/ips" status: 200 len: 151 microversion: 2.1 time: 0.042042 Aug 25 03:13:33.655659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 421/878] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:13:33 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:13:35.608347 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d145db1-cc4a-4432-a563-3727fa4f0ae7"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:35.610713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:35.617835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:35.618316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:35.618745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:35.619432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:35.620078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:35.620530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:36.903521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8825c561-a513-44dc-882d-24bf973c39cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.298986 Aug 25 03:13:36.904189 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 458/879] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:13:35 2022] POST /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments => generated 194 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:46.645635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3087a7ff-898a-4632-87d3-aa23b0ad1fd6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: .version_select at 0x7ff19b3f93a0>, body: {"keypair": {"name": "tempest-keypair-306683223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYDxMhT15uWCdhe6AMaZ8Cn9YmcOVI7y0pvxUj26nLsY7TBfF2CdEsYXW3vFhDC4Pl5mHmpQsPbdILULRJztOd/7L7J0V7FbJmTn1tpIn7mDDgDfLFeoJL1N6RxGSjxlw=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:46.651489 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=91 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:46.662600 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-3087a7ff-898a-4632-87d3-aa23b0ad1fd6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:13:46.666380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-3087a7ff-898a-4632-87d3-aa23b0ad1fd6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:13:46.751490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3087a7ff-898a-4632-87d3-aa23b0ad1fd6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109910 Aug 25 03:13:46.752115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 422/880] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:13:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:49.480546 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:49.481498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:13:49.486028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-830938148", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ca25ebd-ab9b-4352-95b3-63248390eeaa"}], "security_groups": [{"name": "tempest-securitygroup--1690535156"}], "key_name": "tempest-keypair-306683223", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:49.594846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] validate_networks() for [('1ca25ebd-ab9b-4352-95b3-63248390eeaa', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:13:49.980461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:13:49.980887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:13:49.981366 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:13:49.981779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:13:49.982223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:13:49.991774 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:49.992317 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:49.992797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:49.993513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:49.993967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:49.994396 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:50.012229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:13:50.016273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:13:50.027672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:13:50.030120 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:13:50.164559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-66d468eb-bd2e-4184-b519-a64bdee292b4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.685389 Aug 25 03:13:50.165528 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 459/881] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:13:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:13:50.178257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-41314b5c-d088-4bea-bc9d-eb9f6ffbc8a3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:50.179525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-41314b5c-d088-4bea-bc9d-eb9f6ffbc8a3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:50.243829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-41314b5c-d088-4bea-bc9d-eb9f6ffbc8a3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:50.250132 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-41314b5c-d088-4bea-bc9d-eb9f6ffbc8a3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1240 microversion: 2.1 time: 0.077753 Aug 25 03:13:50.250703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 423/882] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:50 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:51.271793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:51.275723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:51.279174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:51.279668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:51.280104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:51.280846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:51.281397 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:51.281723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:51.347621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:51.353689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c321b8a7-1177-423b-ba71-3dca5eac4f61 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1244 microversion: 2.1 time: 0.086974 Aug 25 03:13:51.354256 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 460/883] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:51 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:52.378386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:52.378386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:52.383713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:52.384226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:52.384649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:52.385335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:52.385904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:52.386328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:52.450773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:52.460328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-91a8bc9c-c99b-4f53-b14b-2222e24d3afd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1292 microversion: 2.1 time: 0.089764 Aug 25 03:13:52.461430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 424/884] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:52 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:53.483807 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:53.489240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:53.491711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:53.492224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:53.492660 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:53.493345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:53.493796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:53.494220 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:53.581234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:53.581234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fcd373ed-9a2b-4f61-9857-a34d0c30a1e3 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1298 microversion: 2.1 time: 0.084551 Aug 25 03:13:53.581234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 461/885] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:53 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:54.586686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:54.587929 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:54.595505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:54.596329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:54.597685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:54.598561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:54.599010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:54.599428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:54.801171 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:54.811290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8942b791-6fa4-4928-9871-3f485e49d8c8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.226305 Aug 25 03:13:54.811290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 425/886] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:54 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:13:54.960674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7427fc-d39b-40c5-b938-2e054cbba63c", "tag": "c58f1c44-d9e2-4a76-8ac4-963888760761"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:13:54.970870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:54.971489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:54.971920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:54.982560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] Creating event network-changed:c58f1c44-d9e2-4a76-8ac4-963888760761 for instance 2f7427fc-d39b-40c5-b938-2e054cbba63c on hv-cinder-77957 Aug 25 03:13:54.987789 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-502958dc-a539-4f0c-b421-fc544172a419 req-b6100f68-dd56-4cf7-9f48-988b8a1e25db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030757 Aug 25 03:13:54.988609 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 462/887] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:13:55.831531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:55.832172 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:55.838546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:55.839021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:55.839458 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:55.840133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:55.840606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:55.841025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:55.978787 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:55.986451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-455f7970-d4a0-4a17-9709-17c4fab05d9e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.159372 Aug 25 03:13:55.987209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 426/888] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:55 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:57.008619 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:57.009314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:57.015343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:57.015817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:57.016284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:57.016967 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:57.017414 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:57.017927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:57.155866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:57.164581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5fe75e1a-3326-432d-a1ef-f22dc3ad340e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.160510 Aug 25 03:13:57.165247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 463/889] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:57 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:58.186185 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:58.186824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:58.193582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:58.200421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:58.200421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:58.200421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:58.200421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:58.200891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:58.328879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:58.337307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0d002056-75cf-4d89-9664-453ea2efa4e8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.155124 Aug 25 03:13:58.337906 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 427/890] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:58 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:13:59.357683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:13:59.358257 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:13:59.365376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:59.365851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:59.366299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:59.366974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:13:59.367417 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:13:59.367835 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:13:59.500931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:13:59.508668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4d535942-eec3-4189-87c1-4acf9c8f22dc tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.154807 Aug 25 03:13:59.509231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 464/891] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:13:59 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:00.530196 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:00.530742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:00.533086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:00.537941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:00.538424 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:00.538849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:00.539524 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:00.539970 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:00.540416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:00.688573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:00.696649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-867e5fff-5dba-4240-af11-0c281eff082e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.170321 Aug 25 03:14:00.697222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 428/892] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:00 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:01.717918 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:01.718569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:01.721875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:01.722553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:01.726637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:01.727216 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:01.727851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:01.728388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:01.728866 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:01.729289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.022689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:02.030873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9da46e14-ca1d-4852-bc7e-e2a5ad874460 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.316738 Aug 25 03:14:02.031763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 465/893] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:01 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:02.103712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7427fc-d39b-40c5-b938-2e054cbba63c", "name": "network-vif-plugged", "status": "completed", "tag": "c58f1c44-d9e2-4a76-8ac4-963888760761"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:02.115543 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:02.116019 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:02.116478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.127679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] Creating event network-vif-plugged:c58f1c44-d9e2-4a76-8ac4-963888760761 for instance 2f7427fc-d39b-40c5-b938-2e054cbba63c on hv-cinder-77957 Aug 25 03:14:02.132848 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-f5f77682-bdd0-4e97-96e0-1e23b342eb03 req-925d3615-aea2-4300-ac02-8ed706466406 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032745 Aug 25 03:14:02.133504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 429/894] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:02.576685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:02.578939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:02.585444 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:02.585944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:02.586395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.587128 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:02.587580 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:02.588003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.618048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b7f78cde-5148-4116-9a33-4cf4df445bc6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045610 Aug 25 03:14:02.618593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 466/895] 10.222.0.75 () {60 vars in 1343 bytes} [Thu Aug 25 03:14:02 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:02.693030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:02.693670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:02.700066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:02.700621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:02.701056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.701741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:02.702191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:02.702613 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:02.729366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:14:03.052269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:03.052875 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:03.059299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:03.059777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:03.060232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:03.060970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:03.061411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:03.061859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:03.063030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9eecc3cc-0cc8-4980-8615-9b786a78d27f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 204 len: 0 microversion: 2.20 time: 0.374400 Aug 25 03:14:03.063627 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 430/896] 10.222.0.75 () {60 vars in 1280 bytes} [Thu Aug 25 03:14:02 2022] DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:14:03.073020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:03.073720 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:03.079721 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:03.080961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:03.081406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:03.082136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:03.082596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:03.083020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:03.195034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:03.203691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e1ae6896-1927-4b3f-aef3-3b5aae009956 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.155581 Aug 25 03:14:03.204525 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 467/897] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:03 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:03.223425 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:03.231900 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:03.233441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:03.234728 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1e91205b-4c36-4fb7-af4d-c07140c0130a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.166061 Aug 25 03:14:03.235150 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 431/898] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:03 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:14:04.226330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:04.227052 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:04.233577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:04.234063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:04.234495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:04.235190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:04.235645 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:04.236069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:04.259290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:04.268329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:04.275146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:04.275685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:04.276127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:04.276898 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:04.277357 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:04.277777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:04.367772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:04.376017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-11a59f78-c6ed-4dc5-9647-4baa37561ad5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1366 microversion: 2.1 time: 0.153702 Aug 25 03:14:04.376607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 468/899] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:04 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:04.413440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:04.421497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:04.422985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:04.424234 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7f036b5f-c1ae-48d7-bc36-9ff4171f6505 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.168895 Aug 25 03:14:04.424708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 432/900] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:04 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:14:05.397117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:05.397878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:05.404596 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.405081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.405513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.406206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.406658 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.407078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.447059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:05.448800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:05.457056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.457831 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.458244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.458954 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.459677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.460360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.553665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:05.562290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6031200e-a111-4c89-83f9-b7c4f7c99c34 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1557 microversion: 2.1 time: 0.169287 Aug 25 03:14:05.563834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 469/901] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:05 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:05.595952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:05.597474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:05.605470 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.606110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.606622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.607430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:05.607948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:05.608473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:05.654804 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:05.664649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:05.666295 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:05.667724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2b1342d3-d4d9-4219-937b-d44af8ebf5d2 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1725 microversion: 2.20 time: 0.224719 Aug 25 03:14:05.668334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 433/902] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:05 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 25 03:14:05.692361 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c0e7bd2e-add6-48fd-9086-c944a64299dd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103404 Aug 25 03:14:05.693477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 470/903] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:14:05 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:06.059589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fede0266-7f08-4740-b64d-c7900ee062d2", "name": "network-vif-deleted", "tag": "f2e0dc32-497f-4383-adcb-7c003a2e463a"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:06.070666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:06.071519 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:06.072417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:06.085302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] Creating event network-vif-deleted:f2e0dc32-497f-4383-adcb-7c003a2e463a for instance fede0266-7f08-4740-b64d-c7900ee062d2 on hv-cinder-77957 Aug 25 03:14:06.090839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-9e9ab702-cde5-40c2-aa64-9bdbd4dd2f1f req-bd27b81f-95ee-4b46-b09d-7a4dde4fe8da service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Aug 25 03:14:06.091564 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 434/904] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:06.693221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:06.695697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:06.704405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:06.707438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:06.708057 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:06.709138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:06.709744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:06.710378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:06.763840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:06.764631 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:06.765215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:06.766754 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lazy-loading 'fault' on Instance uuid fede0266-7f08-4740-b64d-c7900ee062d2 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:07.081569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:07.093330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:07.095230 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe93db6503a143ab9ed50fedbc8f010f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3d0ec7db3c4b3b8625c575a2a11ec8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:07.097905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-af7266b6-0aa0-4bc7-b3ab-97f56864e374 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 200 len: 1372 microversion: 2.20 time: 0.411080 Aug 25 03:14:07.098665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 471/905] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:06 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 25 03:14:07.146481 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7427fc-d39b-40c5-b938-2e054cbba63c", "tag": "c58f1c44-d9e2-4a76-8ac4-963888760761"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:07.163443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:07.163923 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:07.164396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:07.176882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] Creating event network-changed:c58f1c44-d9e2-4a76-8ac4-963888760761 for instance 2f7427fc-d39b-40c5-b938-2e054cbba63c on hv-cinder-77957 Aug 25 03:14:07.182214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-3c1f34e5-1cae-4ab5-8561-9591acc86e38 req-44ebe4f6-9f53-4152-b547-2106849d7504 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040189 Aug 25 03:14:07.183266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 435/906] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:08.123255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:08.123946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:08.131233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:08.131712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:08.132177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:08.133095 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:08.133547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:08.133992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:08.148551 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 HTTP/1.1 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:08.150097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:08.151831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'fede0266-7f08-4740-b64d-c7900ee062d2'} Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:08.155304 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:08.156884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:08.158291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:08.158291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c9a103ac-4806-4276-bbfd-47cd531758cd tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 404 len: 111 microversion: 2.20 time: 0.032419 Aug 25 03:14:08.158291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 472/907] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:08 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:08.163815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c0d39e7c-3917-4c5a-9f84-3bb7ae85a8d3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '.version_select at 0x7ff19b31d5e0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:08.292869 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c0d39e7c-3917-4c5a-9f84-3bb7ae85a8d3 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093134122" status: 204 len: 0 microversion: 2.20 time: 0.134718 Aug 25 03:14:08.293453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 436/908] 10.222.0.75 () {60 vars in 1262 bytes} [Thu Aug 25 03:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093134122 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 25 03:14:10.616292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:10.616784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:10.623467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:10.623945 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:10.624459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:10.625148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:10.625600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:10.626025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:10.640328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 HTTP/1.1 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:10.641872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.644067 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'fede0266-7f08-4740-b64d-c7900ee062d2'} Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:10.644986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.646393 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.647797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:10.647797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1c2a70d9-b314-47bb-9a06-f2a79f1326e6 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 404 len: 111 microversion: 2.20 time: 0.031453 Aug 25 03:14:10.647797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 473/909] 10.222.0.75 () {60 vars in 1280 bytes} [Thu Aug 25 03:14:10 2022] DELETE /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:10.653560 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:10.654297 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: fede0266-7f08-4740-b64d-c7900ee062d2] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:10.661179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:10.661655 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:10.662086 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:10.662757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:10.663376 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:10.663799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:10.677391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 HTTP/1.1 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:10.679012 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.680889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'fede0266-7f08-4740-b64d-c7900ee062d2'} Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:10.681756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. Aug 25 03:14:10.683333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:10.684605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance fede0266-7f08-4740-b64d-c7900ee062d2 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:10.684605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0f26cf82-2f99-48c3-862c-c17bb032e9b5 tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2" status: 404 len: 111 microversion: 2.20 time: 0.031328 Aug 25 03:14:10.684605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 437/910] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:10 2022] GET /compute/v2.1/servers/fede0266-7f08-4740-b64d-c7900ee062d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:12.108424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:12.109002 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:12.115455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:12.116034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:12.116510 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:12.117204 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:12.117661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:12.118086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:12.133135 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 HTTP/1.1 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:12.134598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.136206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '650fe7f9-3642-4118-9da6-e217c1d9d1e6'} Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:12.137392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.139060 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.140722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:12.140722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-513b40cc-1af4-470f-811d-8ed13f77324f tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 404 len: 111 microversion: 2.20 time: 0.031445 Aug 25 03:14:12.140722 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 474/911] 10.222.0.75 () {60 vars in 1280 bytes} [Thu Aug 25 03:14:12 2022] DELETE /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:12.145713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:12.146319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] [instance: 650fe7f9-3642-4118-9da6-e217c1d9d1e6] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:12.152706 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:12.153177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:12.153609 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:12.154289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:12.154732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:12.155146 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:12.170055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] HTTP exception thrown: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Request method failure captured: Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 HTTP/1.1 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuckSV4a8YS6NxXCHrgynKS94shYrR191ByYG3dFfr5qXXqmHYXh00CQYS8foKjM91z1VnFiiZChjnhcTAEGIIqpqcq_rEOCNLKJdD3uuHB5BpnT_1AQPkFQNkzhk-gn8T-MGhcZK7JmsMI2Xsr1bdonQD-qWkQ6xq1N__gbDGLpYC0 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Openstack-Nova-Api-Version: 2.20 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:12.172181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1d3d0ec7db3c4b3b8625c575a2a11ec8"}]}] Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 1d3d0ec7db3c4b3b8625c575a2a11ec8 Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-282740993 Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: fe93db6503a143ab9ed50fedbc8f010f Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeShelveTestJSON-282740993-project Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.173546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '650fe7f9-3642-4118-9da6-e217c1d9d1e6'} Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:12.174280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. Aug 25 03:14:12.180320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:12.181861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] Returning 404 to user: Instance 650fe7f9-3642-4118-9da6-e217c1d9d1e6 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:12.181861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-750cb73b-f3af-4a71-922d-36ea13e9452a tempest-AttachVolumeShelveTestJSON-282740993 tempest-AttachVolumeShelveTestJSON-282740993-project] 10.222.0.75 "GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6" status: 404 len: 111 microversion: 2.20 time: 0.034000 Aug 25 03:14:12.181861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 438/912] 10.222.0.75 () {60 vars in 1277 bytes} [Thu Aug 25 03:14:12 2022] GET /compute/v2.1/servers/650fe7f9-3642-4118-9da6-e217c1d9d1e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:13.793079 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:13.794209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:13.797286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:13.802272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:13.803155 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:13.803820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:13.804790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:13.805445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:13.806079 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:13.807881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:13.808441 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:13.808952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:13.833890 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] Creating event network-changed:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:14:13.844184 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-dac4e046-defd-4c4a-9b7e-d663bcb16d28 req-af4dc321-f1e5-4cb4-9c6b-f97c280a720f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050633 Aug 25 03:14:13.844833 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 439/913] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:13.853928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:14:14.440281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a9b02f5a-b2ca-4ec0-9be7-9899218d46b5 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 204 len: 0 microversion: 2.1 time: 0.650953 Aug 25 03:14:14.442018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 475/914] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:14:13 2022] DELETE /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:14:14.450868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:14.451559 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:14.459003 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:14.459757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:14.460495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:14.461390 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:14.462000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:14.462576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:14.616217 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:14.632405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-df76f6a3-2704-42aa-b8c1-b880fee3a9ab tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.185145 Aug 25 03:14:14.634327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 440/915] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:14 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:15.657726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:15.660456 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:15.667847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:15.668747 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:15.669342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:15.670641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:15.671447 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:15.672037 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:15.849424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:15.865558 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-344d4f4c-5b59-4958-8163-4dfd7959a9bb tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1567 microversion: 2.1 time: 0.212563 Aug 25 03:14:15.886046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 476/916] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:15 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:16.887473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:16.888449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:16.902794 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:16.903445 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:16.904122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:16.904960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:16.905518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:16.907019 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:16.917221 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:17.019460 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:17.027149 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4d2a2774-8cde-4f8f-9fc9-5e655bdcac0a tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1381 microversion: 2.1 time: 0.143692 Aug 25 03:14:17.027927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 441/917] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:16 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1381 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:17.059368 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb779de8-4034-4b32-a378-d65e4bbdbf71", "name": "network-vif-deleted", "tag": "c21206be-eb06-4c5c-87e2-32b7265507d1"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:17.073935 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:17.075217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:17.075823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:17.081862 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:17.091375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] Creating event network-vif-deleted:c21206be-eb06-4c5c-87e2-32b7265507d1 for instance bb779de8-4034-4b32-a378-d65e4bbdbf71 on hv-cinder-77957 Aug 25 03:14:17.097276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-13564aaa-97eb-4074-a3bc-eb9522e7604b req-f197512e-9d03-42f3-a77b-0b7e465cf0a9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042153 Aug 25 03:14:17.098156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 477/918] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:14:18.054520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:18.060725 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:18.062225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:18.062694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:18.063124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:18.063810 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:18.064292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:18.064713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:18.133972 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:18.143431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c0563a1d-bf64-4d2b-867b-e76c0c0ac1ca tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1219 microversion: 2.1 time: 0.092433 Aug 25 03:14:18.144513 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 442/919] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:18 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:19.166629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:19.170655 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:19.173928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:19.174402 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:19.174827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:19.176098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:19.176516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:19.176926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:19.207034 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:19.207495 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:19.207921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:19.208406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lazy-loading 'fault' on Instance uuid bb779de8-4034-4b32-a378-d65e4bbdbf71 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:19.250720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927c54860d840538bab1004441c104b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54df2648916c4681af69062a1d5b7430', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:19.259636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ffb9592f-eb9d-48e5-a1fd-bdd408fde0e0 tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 200 len: 1224 microversion: 2.1 time: 0.098338 Aug 25 03:14:19.261087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 478/920] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:19 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:19.978366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6eaaf973-665f-4083-9dbd-b3a271f4a94b tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Action: 'create', calling method: .version_select at 0x7ff19b3a6700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2128011295"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:20.289788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:20.290575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] [instance: bb779de8-4034-4b32-a378-d65e4bbdbf71] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:20.293517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:20.298695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:20.299185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:20.299628 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:20.300593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:20.301329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:20.303165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:20.319870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] HTTP exception thrown: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Request method failure captured: Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 HTTP/1.1 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuen4CWZtD4nsRrGGqZ2jpDc296o4MmxaHNUupAIqQfrEBa4igNIYps37E_5H17d37NYr-MGsaBB-G9YjjXB9zgEh91awnI5paiFOrhFNgtyqnMXgVVbb4edafbOC4XjKT014iFnZbHCDUhdXoXGWKU6ym-lsPCnZf0J-8P7QwFP8IM Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 54df2648916c4681af69062a1d5b7430 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-TestShelveInstance-969934618 Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:20.321755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/54df2648916c4681af69062a1d5b7430"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/54df2648916c4681af69062a1d5b7430"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/54df2648916c4681af69062a1d5b7430"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_54df2648916c4681af69062a1d5b7430"}]}] Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-TestShelveInstance-969934618 Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 54df2648916c4681af69062a1d5b7430 Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-TestShelveInstance-969934618 Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-TestShelveInstance-969934618-project Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: 2927c54860d840538bab1004441c104b Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-TestShelveInstance-969934618-project Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. Aug 25 03:14:20.329839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'bb779de8-4034-4b32-a378-d65e4bbdbf71'} Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:20.330931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. Aug 25 03:14:20.333032 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:20.334398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Returning 404 to user: Instance bb779de8-4034-4b32-a378-d65e4bbdbf71 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:20.334398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-49ab6feb-9102-4284-a4b7-654047bc1aad tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71" status: 404 len: 111 microversion: 2.1 time: 0.037735 Aug 25 03:14:20.334398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 479/921] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:20 2022] GET /compute/v2.1/servers/bb779de8-4034-4b32-a378-d65e4bbdbf71 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:20.630746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d27d7e39-a638-46d5-bcd1-47bfb002b33e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] Calling method '.version_select at 0x7ff197a171f0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:20.756126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d27d7e39-a638-46d5-bcd1-47bfb002b33e tempest-TestShelveInstance-969934618 tempest-TestShelveInstance-969934618-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1103826834" status: 202 len: 0 microversion: 2.1 time: 0.131039 Aug 25 03:14:20.756927 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 480/922] 10.222.0.75 () {58 vars in 1254 bytes} [Thu Aug 25 03:14:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1103826834 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:14:20.800289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6eaaf973-665f-4083-9dbd-b3a271f4a94b tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.968233 Aug 25 03:14:20.800289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 443/923] 10.222.0.75 () {60 vars in 1155 bytes} [Thu Aug 25 03:14:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 970 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 25 03:14:20.806695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-52e1bd20-752e-421d-87dd-65e5f82be80c tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3fd550>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:20.859404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-52e1bd20-752e-421d-87dd-65e5f82be80c tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 200 len: 345 microversion: 2.1 time: 0.057364 Aug 25 03:14:20.860179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 481/924] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:14:20 2022] GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:21.874244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9d266a70-c3e1-4ac8-a173-c367cfaf48b8 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3b6040>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:21.932667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9d266a70-c3e1-4ac8-a173-c367cfaf48b8 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 200 len: 346 microversion: 2.1 time: 0.062871 Aug 25 03:14:21.938578 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 444/925] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:14:21 2022] GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:21.948223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-558c6be3-b037-45ea-b034-c62ac8d57337 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Action: 'create', calling method: .version_select at 0x7ff197a25310>, body: {"snapshot": {"volume_id": "0399a321-5b96-46bc-a838-0811e4be0b93", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2060175307"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:22.636134 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-558c6be3-b037-45ea-b034-c62ac8d57337 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.693604 Aug 25 03:14:22.643080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 482/926] 10.222.0.75 () {60 vars in 1162 bytes} [Thu Aug 25 03:14:21 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:22.648736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d52952a8-df5e-465d-a22f-137833a7ba1a tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3b6430>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:22.687766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d52952a8-df5e-465d-a22f-137833a7ba1a tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.044150 Aug 25 03:14:22.688367 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 445/927] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:22 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:14:22.700196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9cbc8de3-72b6-43ef-acc6-62a352049a53 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff197a173a0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:22.730463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9cbc8de3-72b6-43ef-acc6-62a352049a53 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034126 Aug 25 03:14:22.731033 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 483/928] 10.222.0.75 () {58 vars in 1140 bytes} [Thu Aug 25 03:14:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:14:22.742451 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b558c066-e196-4ed6-9ffc-9d23b0908f38 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3b6dc0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:22.777938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b558c066-e196-4ed6-9ffc-9d23b0908f38 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.039205 Aug 25 03:14:22.778539 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 446/929] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:22 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:23.791226 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e2e77d63-c8aa-499c-995f-2de67d2bf9d1 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3fdd30>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:23.821695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e2e77d63-c8aa-499c-995f-2de67d2bf9d1 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.035187 Aug 25 03:14:23.822618 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 484/930] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:23 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:24.834634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-009ba227-143c-4c99-8aef-1ac60c9dc7a2 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff193a6fdc0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:24.865364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-009ba227-143c-4c99-8aef-1ac60c9dc7a2 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.035120 Aug 25 03:14:24.866206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 447/931] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:24 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:25.880365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-87d72835-52dd-4e2d-8fe4-621d1b314e09 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b320dc0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:25.912847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-87d72835-52dd-4e2d-8fe4-621d1b314e09 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.037962 Aug 25 03:14:25.913426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 485/932] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:25 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:26.251569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1325202016", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:26.259723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:26.314168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] validate_networks() for None {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:14:26.602504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:14:26.603035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:14:26.603587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:14:26.603924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:14:26.604364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:14:26.613166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:26.613642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:26.614076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:26.614803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:26.615261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:26.615687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:26.633748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Getting quotas for project b6c389c35c7f433a912a8c1dbde72f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:14:26.637952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Getting quotas for user 7b8fe8d5a5d84183a515eb49ec75a21c and project b6c389c35c7f433a912a8c1dbde72f69. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:14:26.652076 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:14:26.657197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:14:26.854271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e723c355-40f9-49a9-829d-3c089116b1d8 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606944 Aug 25 03:14:26.863688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 448/933] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:14:26.867025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-920a2064-1edb-48e6-b51a-d0c2868a346d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:26.875819 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-920a2064-1edb-48e6-b51a-d0c2868a346d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:26.925585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0538ef89-552b-49a0-8b7c-e3ef4c928333 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff193a95a60>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:26.963632 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-920a2064-1edb-48e6-b51a-d0c2868a346d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:26.976872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-920a2064-1edb-48e6-b51a-d0c2868a346d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1215 microversion: 2.1 time: 0.111071 Aug 25 03:14:26.977746 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 486/934] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:26 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:26.997347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0538ef89-552b-49a0-8b7c-e3ef4c928333 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 288 microversion: 2.1 time: 0.073647 Aug 25 03:14:26.997347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 449/935] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:26 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:14:27.007940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5d0860f5-3048-4627-b6de-c51670dc5688 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff193abaca0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:27.140001 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5d0860f5-3048-4627-b6de-c51670dc5688 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 202 len: 0 microversion: 2.1 time: 0.135841 Aug 25 03:14:27.140816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 450/936] 10.222.0.75 () {58 vars in 1254 bytes} [Thu Aug 25 03:14:27 2022] DELETE /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:14:27.149751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0fe28419-cc50-47c0-bbaf-f5fe604c767b tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3e4a60>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:27.187252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0fe28419-cc50-47c0-bbaf-f5fe604c767b tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 200 len: 287 microversion: 2.1 time: 0.041216 Aug 25 03:14:27.188392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 487/937] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:27 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:28.001199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1f600b02-2b8f-46bf-8d99-f27d418ac40b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:28.002518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1f600b02-2b8f-46bf-8d99-f27d418ac40b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:28.069270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1f600b02-2b8f-46bf-8d99-f27d418ac40b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:28.077637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1f600b02-2b8f-46bf-8d99-f27d418ac40b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1215 microversion: 2.1 time: 0.080237 Aug 25 03:14:28.078214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 451/938] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:27 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:28.208343 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-954276dd-7642-4782-a779-e8d8bac51a94 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3e4670>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:28.256535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-954276dd-7642-4782-a779-e8d8bac51a94 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] HTTP exception thrown: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-954276dd-7642-4782-a779-e8d8bac51a94 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Request method failure captured: Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 HTTP/1.1 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBukLX5WE1aXk1ZdmA0AqCuqYMQ0LnQxscAE-IqvVfN8X1u2bld3jgpnI1Q5HF-997ohgk3wUMSpoaxEpYuDAV53_sXBW9I-zNLJZynkTPTWJqmiYFlYX5t1k62tE1noMIpHRVoyzSYtkzoVESS839Mpb_CJldWEF1eaqXDMt70CcsPY Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:28.259080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2a5f3f3c8da84b49850bee8c32d1ce94"}]}] Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: d86706c2feb840cb9cc85b530be372f0 Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'f01ed5f5-dbf5-4c68-b7d9-6130a3293797'} Aug 25 03:14:28.260526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. (HTTP 404) (Request-ID: req-d9f5d604-2f93-471b-a30b-6991b7ada14e) Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.261406 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:28.263301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 25 03:14:28.265869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-954276dd-7642-4782-a779-e8d8bac51a94 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Returning 404 to user: Snapshot f01ed5f5-dbf5-4c68-b7d9-6130a3293797 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:28.268116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-954276dd-7642-4782-a779-e8d8bac51a94 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797" status: 404 len: 111 microversion: 2.1 time: 0.062849 Aug 25 03:14:28.270836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 488/939] 10.222.0.75 () {58 vars in 1251 bytes} [Thu Aug 25 03:14:28 2022] GET /compute/v2.1/os-snapshots/f01ed5f5-dbf5-4c68-b7d9-6130a3293797 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:28.271726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-feabed47-587f-4350-a1e1-99942d37b8d7 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff193abaf70>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:28.576706 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-feabed47-587f-4350-a1e1-99942d37b8d7 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 202 len: 0 microversion: 2.1 time: 0.310878 Aug 25 03:14:28.579965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 452/940] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:14:28 2022] DELETE /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:14:28.586280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5fbeab6d-9589-4fcc-a407-3eda1d6bcd91 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3fdaf0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:28.638734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5fbeab6d-9589-4fcc-a407-3eda1d6bcd91 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 200 len: 345 microversion: 2.1 time: 0.057063 Aug 25 03:14:28.639312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 489/941] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:14:28 2022] GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:29.100807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:29.102103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:29.108482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:29.109230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:29.109824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:29.110649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:29.111252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:29.111947 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:29.175924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:29.183882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e4e4b040-1d06-443b-bc4f-4840abd6c704 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1211 microversion: 2.1 time: 0.088309 Aug 25 03:14:29.184510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 453/942] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:29 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:29.654193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-13e33612-5093-40b1-aee4-781b30860131 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff197a25430>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:29.688455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-13e33612-5093-40b1-aee4-781b30860131 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] HTTP exception thrown: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-13e33612-5093-40b1-aee4-781b30860131 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Request method failure captured: Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 HTTP/1.1 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBukLX5WE1aXk1ZdmA0AqCuqYMQ0LnQxscAE-IqvVfN8X1u2bld3jgpnI1Q5HF-997ohgk3wUMSpoaxEpYuDAV53_sXBW9I-zNLJZynkTPTWJqmiYFlYX5t1k62tE1noMIpHRVoyzSYtkzoVESS839Mpb_CJldWEF1eaqXDMt70CcsPY Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:29.689576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2a5f3f3c8da84b49850bee8c32d1ce94"}]}] Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: d86706c2feb840cb9cc85b530be372f0 Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '0399a321-5b96-46bc-a838-0811e4be0b93'} Aug 25 03:14:29.692174 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. (HTTP 404) (Request-ID: req-74332a7e-8443-4e35-9031-7b220b4bc886) Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.693127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:29.694948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:14:29.696404 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-13e33612-5093-40b1-aee4-781b30860131 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Returning 404 to user: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-13e33612-5093-40b1-aee4-781b30860131 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 404 len: 109 microversion: 2.1 time: 0.042396 Aug 25 03:14:29.697749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 490/943] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:14:29 2022] GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:29.705666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-86b7f85a-2b24-48e1-99cc-4db450a70342 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3f95e0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:29.742547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-86b7f85a-2b24-48e1-99cc-4db450a70342 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] HTTP exception thrown: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-86b7f85a-2b24-48e1-99cc-4db450a70342 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Request method failure captured: Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: DELETE /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 HTTP/1.1 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBukLX5WE1aXk1ZdmA0AqCuqYMQ0LnQxscAE-IqvVfN8X1u2bld3jgpnI1Q5HF-997ohgk3wUMSpoaxEpYuDAV53_sXBW9I-zNLJZynkTPTWJqmiYFlYX5t1k62tE1noMIpHRVoyzSYtkzoVESS839Mpb_CJldWEF1eaqXDMt70CcsPY Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:29.744656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2a5f3f3c8da84b49850bee8c32d1ce94"}]}] Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: d86706c2feb840cb9cc85b530be372f0 Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '0399a321-5b96-46bc-a838-0811e4be0b93'} Aug 25 03:14:29.746198 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. (HTTP 404) (Request-ID: req-a3acad69-1d81-4a89-b705-5cbbfc1a7bb1) Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.747349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 25 03:14:29.748812 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 25 03:14:29.750265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-86b7f85a-2b24-48e1-99cc-4db450a70342 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Returning 404 to user: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-86b7f85a-2b24-48e1-99cc-4db450a70342 tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 404 len: 109 microversion: 2.1 time: 0.044364 Aug 25 03:14:29.751738 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 454/944] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:14:29 2022] DELETE /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:29.755612 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d36cb85c-24ec-4068-8d0d-d8f4c445037e tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Calling method '.version_select at 0x7ff19b3fda60>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-d36cb85c-24ec-4068-8d0d-d8f4c445037e tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] HTTP exception thrown: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d36cb85c-24ec-4068-8d0d-d8f4c445037e tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Request method failure captured: Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 HTTP/1.1 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBukLX5WE1aXk1ZdmA0AqCuqYMQ0LnQxscAE-IqvVfN8X1u2bld3jgpnI1Q5HF-997ohgk3wUMSpoaxEpYuDAV53_sXBW9I-zNLJZynkTPTWJqmiYFlYX5t1k62tE1noMIpHRVoyzSYtkzoVESS839Mpb_CJldWEF1eaqXDMt70CcsPY Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:14:29.797523 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/2a5f3f3c8da84b49850bee8c32d1ce94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_2a5f3f3c8da84b49850bee8c32d1ce94"}]}] Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 2a5f3f3c8da84b49850bee8c32d1ce94 Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481584770 Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: d86706c2feb840cb9cc85b530be372f0 Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481584770-project Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '0399a321-5b96-46bc-a838-0811e4be0b93'} Aug 25 03:14:29.798924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. (HTTP 404) (Request-ID: req-af218c8e-a73b-42cf-b8ce-24fcdcc8f7e4) Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.799708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 25 03:14:29.801581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 25 03:14:29.803252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d36cb85c-24ec-4068-8d0d-d8f4c445037e tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] Returning 404 to user: Volume 0399a321-5b96-46bc-a838-0811e4be0b93 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d36cb85c-24ec-4068-8d0d-d8f4c445037e tempest-VolumesSnapshotsTestJSON-1481584770 tempest-VolumesSnapshotsTestJSON-1481584770-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93" status: 404 len: 109 microversion: 2.1 time: 0.043050 Aug 25 03:14:29.804646 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 491/945] 10.222.0.75 () {58 vars in 1245 bytes} [Thu Aug 25 03:14:29 2022] GET /compute/v2.1/os-volumes/0399a321-5b96-46bc-a838-0811e4be0b93 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:30.206687 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:30.207363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:30.218553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:30.219047 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:30.219522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:30.221162 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:30.223006 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:30.223458 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:30.286639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:30.299418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6516334e-1e46-41d9-be30-2dacd8879d71 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1285 microversion: 2.1 time: 0.093455 Aug 25 03:14:30.299418 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 455/946] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:30 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:31.322783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:31.323550 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:31.331291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:31.332133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:31.332827 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:31.333911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:31.334541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:31.335130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:31.514460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:31.528613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b27d72ef-4a53-43f0-bcf3-381cc303b9a7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.210708 Aug 25 03:14:31.529508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 492/947] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:31 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:32.384585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21454497-4aa2-47ea-8802-961125bc0f09", "tag": "3cba6e38-d760-4ae3-8e33-0d4f5b67656c"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:32.396944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:32.397716 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:32.398438 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:32.410964 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] Creating event network-changed:3cba6e38-d760-4ae3-8e33-0d4f5b67656c for instance 21454497-4aa2-47ea-8802-961125bc0f09 on hv-cinder-77957 Aug 25 03:14:32.417175 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-47f99c12-72ba-45b7-b876-b8fab9889c49 req-c8629f53-229d-438c-9f20-aaf5c29c6fb3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036848 Aug 25 03:14:32.418269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 456/948] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:32.561547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:32.563313 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:32.571663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:32.572364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:32.572948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:32.573881 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:32.574326 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:32.574745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:32.722913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:32.730910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b8e3f7a3-cf04-46e0-9376-f6a7ccf11a51 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.175193 Aug 25 03:14:32.731473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 493/949] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:32 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:33.753878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:33.754585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:33.760930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:33.761502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:33.761963 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:33.762651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:33.763122 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:33.763677 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:33.902249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:33.910953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-87ee225a-e479-4e86-8647-f65c7c6c89a5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.161998 Aug 25 03:14:33.911520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 457/950] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:33 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:34.931221 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:34.932251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:34.938923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:34.939408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:34.939838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:34.940582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:34.941217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:34.941657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:35.078156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:35.093588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9b0ff685-89a4-4f35-803a-b3f691aecce5 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.166312 Aug 25 03:14:35.094091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 494/951] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:34 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:36.115498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:36.116268 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:36.122958 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:36.123435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:36.123868 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:36.124579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:36.125021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:36.125432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:36.257255 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:36.264965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-93342371-d459-4d28-8ba4-eb7cdd5ac98e tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.154139 Aug 25 03:14:36.265527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 458/952] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:36 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:37.286686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:37.287405 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:37.290097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:37.294900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:37.295461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:37.295965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:37.296783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:37.297306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:37.297803 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:37.462280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:37.469872 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a9d0021e-91ec-43a7-a6e4-3aafca77984b tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.187893 Aug 25 03:14:37.470429 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 495/953] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:37 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:38.232996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21454497-4aa2-47ea-8802-961125bc0f09", "name": "network-vif-plugged", "status": "completed", "tag": "3cba6e38-d760-4ae3-8e33-0d4f5b67656c"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:38.238702 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:38.239837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=8 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:38.245018 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:38.245505 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:38.245925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:38.257690 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] Creating event network-vif-plugged:3cba6e38-d760-4ae3-8e33-0d4f5b67656c for instance 21454497-4aa2-47ea-8802-961125bc0f09 on hv-cinder-77957 Aug 25 03:14:38.262762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-17b1876c-90d5-4738-91b7-31f9b77f3416 req-19ddd23d-19d2-4acf-9e37-314f0739fb8a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033542 Aug 25 03:14:38.263528 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 459/954] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:38.491732 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:38.492375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:38.499064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:38.499576 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:38.500009 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:38.500735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:38.501194 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:38.501621 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:38.634081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:38.641920 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-db1a7e1b-c6d5-445f-bece-8590142ebf14 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.154811 Aug 25 03:14:38.642650 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 496/955] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:38 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:39.664393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:39.665129 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:39.671649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:39.672123 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:39.672596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:39.673273 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:39.673718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:39.674114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:39.811934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:39.820483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fc518d9e-fc94-4040-a3c6-ad744aa02806 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1315 microversion: 2.1 time: 0.161584 Aug 25 03:14:39.821225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 460/956] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:39 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:40.841692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:40.842380 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:40.849003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:40.849489 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:40.849946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:40.850639 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:40.851092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:40.851540 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:40.986137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:40.994716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-707a53ea-a627-4983-b75d-633682d12f40 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1464 microversion: 2.1 time: 0.157051 Aug 25 03:14:40.995276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 497/957] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:40 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1464 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:41.050688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:41.055133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:41.058066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:41.058646 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:41.059150 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:41.059913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:41.060510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:41.060878 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:41.086298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:14:41.547497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-245619de-8d5e-4546-aeac-433a844900a9 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "DELETE /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 204 len: 0 microversion: 2.1 time: 0.500972 Aug 25 03:14:41.548005 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 461/958] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:14:41 2022] DELETE /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:14:41.557984 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:41.558625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:41.564641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:41.565193 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:41.565729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:41.566417 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:41.566869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:41.567292 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:41.702580 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:41.711126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-92a12a22-bd84-4cfd-9c11-0c3ba6dd928c tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1470 microversion: 2.1 time: 0.158412 Aug 25 03:14:41.711691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 498/959] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:41 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:42.734897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:42.735786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:42.743579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:42.744165 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:42.744811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:42.745583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:42.746098 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:42.746989 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:42.878331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:42.886247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-74158e7f-c440-45b6-9024-59d73cfdf260 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1470 microversion: 2.1 time: 0.155855 Aug 25 03:14:42.886828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 462/960] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:42 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:43.263252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:43.263784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:43.271705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.272239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.272666 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.273363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.273812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.274240 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.298179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1e4aaef4-ae28-4831-b8e2-2ddb403759e0 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/ips" status: 200 len: 151 microversion: 2.1 time: 0.039285 Aug 25 03:14:43.298763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 499/961] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:14:43 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:43.310932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d145db1-cc4a-4432-a563-3727fa4f0ae7"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:43.313645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:43.320553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.321041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.321497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.322238 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.322703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.323163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.406371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: POST /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/os-volume_attachments HTTP/1.1 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 74 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:43.408353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {"volumeAttachment": {"volumeId": "6d145db1-cc4a-4432-a563-3727fa4f0ae7"}} Aug 25 03:14:43.415579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'server_id': '2f7427fc-d39b-40c5-b938-2e054cbba63c', 'body': {'volumeAttachment': {'volumeId': '6d145db1-cc4a-4432-a563-3727fa4f0ae7'}}} Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:43.416594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:43.417992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 400 to user: Invalid volume: volume 6d145db1-cc4a-4432-a563-3727fa4f0ae7 is already attached to instances: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0edb8f69-cc98-42ba-b334-c40e792bbbf7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103132 Aug 25 03:14:43.419527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 463/962] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:14:43 2022] POST /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:14:43.420214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:43.420315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:43.427091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.427580 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.428012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.428730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.429180 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.430329 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.458884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:14:43.571013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21454497-4aa2-47ea-8802-961125bc0f09", "name": "network-vif-deleted", "tag": "3cba6e38-d760-4ae3-8e33-0d4f5b67656c"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:43.581542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.583279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.583734 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.594717 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] Creating event network-vif-deleted:3cba6e38-d760-4ae3-8e33-0d4f5b67656c for instance 21454497-4aa2-47ea-8802-961125bc0f09 on hv-cinder-77957 Aug 25 03:14:43.607433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-f51050ea-ed15-42d4-8ebe-4892b1375e7b req-15361b47-f0c7-44e5-8023-dbc6689589de service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040495 Aug 25 03:14:43.608261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 464/963] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:43.909244 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:43.911077 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:43.917511 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.918027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.918458 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.919151 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:43.919601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:43.920020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:43.982217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c06b433e-02cd-42d0-8651-5b28ab7b0949 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 204 len: 0 microversion: 2.1 time: 0.566894 Aug 25 03:14:43.982809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 500/964] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:14:43 2022] DELETE /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:14:43.989499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:43.999043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5daac29d-a1ec-4f7b-b1eb-b3e03d589089 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1300 microversion: 2.1 time: 0.094836 Aug 25 03:14:43.999621 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 465/965] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:43 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:43.999816 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:44.000547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:44.007591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:44.008133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:44.008605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:44.009306 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:44.009764 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:44.010196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:44.141708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:44.150098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4a00d5b5-bedb-4451-ae97-6bc95763689e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1682 microversion: 2.1 time: 0.154842 Aug 25 03:14:44.150666 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 501/966] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:43 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:45.022410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:45.023011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:45.029336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:45.029805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:45.030227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:45.030893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:45.031333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:45.031749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:45.171480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:45.172132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:45.179164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:45.179654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:45.180103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:45.180873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:45.181332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:45.181757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:45.214471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:45.214871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:45.215301 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:45.215744 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lazy-loading 'fault' on Instance uuid 21454497-4aa2-47ea-8802-961125bc0f09 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:45.258557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b8fe8d5a5d84183a515eb49ec75a21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c389c35c7f433a912a8c1dbde72f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:45.266348 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9fe019d7-15aa-4307-8b15-2ce93e43cb7d tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 200 len: 1305 microversion: 2.1 time: 0.247933 Aug 25 03:14:45.266913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 466/967] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:45 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 1305 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:45.314837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:45.323042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-00564cec-0aef-4e56-82ec-4594839ecbc5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1682 microversion: 2.1 time: 0.155690 Aug 25 03:14:45.323612 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 502/968] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:45 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:46.290091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:46.290708 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] [instance: 21454497-4aa2-47ea-8802-961125bc0f09] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:46.298393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:46.298393 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:46.298711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:46.299391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:46.299834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:46.300285 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:46.314600 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] HTTP exception thrown: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Request method failure captured: Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 HTTP/1.1 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBukN1XhSVfY0rxLcCJLpVmNsOau14tZkhMJH7T4ExGCA6igMvqbE-fQEESTGPP3DDvO1I_GHL4F47zd--0ZU02Mf7XviV0yCpBXNY9z0OWFpNSv1P3IYGUbAfjAcIvKyYTUMcA_5Hkvk_lMGcNKpDQc2Y9eT3p7I-3GqLPdtweAM7Vc Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: b6c389c35c7f433a912a8c1dbde72f69 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-VolumesNegativeTest-1683984142 Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:46.316261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b6c389c35c7f433a912a8c1dbde72f69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/b6c389c35c7f433a912a8c1dbde72f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/b6c389c35c7f433a912a8c1dbde72f69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_b6c389c35c7f433a912a8c1dbde72f69"}]}] Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-VolumesNegativeTest-1683984142 Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: b6c389c35c7f433a912a8c1dbde72f69 Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-VolumesNegativeTest-1683984142 Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-VolumesNegativeTest-1683984142-project Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: 7b8fe8d5a5d84183a515eb49ec75a21c Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-VolumesNegativeTest-1683984142-project Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. Aug 25 03:14:46.319180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '21454497-4aa2-47ea-8802-961125bc0f09'} Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:46.319985 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. Aug 25 03:14:46.325998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:46.327328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] Returning 404 to user: Instance 21454497-4aa2-47ea-8802-961125bc0f09 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:46.327328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-64488708-4e0f-42a9-8158-acbbca6f4db7 tempest-VolumesNegativeTest-1683984142 tempest-VolumesNegativeTest-1683984142-project] 10.222.0.75 "GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09" status: 404 len: 111 microversion: 2.1 time: 0.031515 Aug 25 03:14:46.327328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 467/969] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:46 2022] GET /compute/v2.1/servers/21454497-4aa2-47ea-8802-961125bc0f09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:46.352790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:46.354001 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:46.362513 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:46.363749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:46.364315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:46.365129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:46.365583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:46.366011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:46.434552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:46.442775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1d1908a4-0100-43da-95e8-6d89fdcb0f03 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1614 microversion: 2.1 time: 0.093862 Aug 25 03:14:46.450206 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 503/970] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:46 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:46.500210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7427fc-d39b-40c5-b938-2e054cbba63c", "name": "network-vif-deleted", "tag": "c58f1c44-d9e2-4a76-8ac4-963888760761"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:46.513379 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:46.514599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:46.515259 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:46.528508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] Creating event network-vif-deleted:c58f1c44-d9e2-4a76-8ac4-963888760761 for instance 2f7427fc-d39b-40c5-b938-2e054cbba63c on hv-cinder-77957 Aug 25 03:14:46.533605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-8ac941ee-2994-4157-b452-b03600cc1c16 req-2b83e6d6-513f-41f6-b8fe-56078b9985a9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037076 Aug 25 03:14:46.534567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 468/971] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:47.463954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:47.468233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:47.473845 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:47.474953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:47.475398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:47.476133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:47.476851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:47.477459 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:47.511004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:47.511704 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:47.512362 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:47.512818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'fault' on Instance uuid 2f7427fc-d39b-40c5-b938-2e054cbba63c {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:47.556574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:47.565448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f6c3e747-f874-4e4d-b4c7-4b4e82569535 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 200 len: 1330 microversion: 2.1 time: 0.105433 Aug 25 03:14:47.578769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 504/972] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:47 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:48.593116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:48.593856 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:48.600267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:48.600746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:48.601178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:48.601855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:48.602303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:48.602724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:48.617049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c HTTP/1.1 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:48.618659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:14:48.620567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '2f7427fc-d39b-40c5-b938-2e054cbba63c'} Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:48.621749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:14:48.623312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:48.624717 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:48.624717 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-427167c3-7088-41fa-8734-06841bb35c63 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 404 len: 111 microversion: 2.1 time: 0.031812 Aug 25 03:14:48.624717 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 469/973] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:48 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:48.630028 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2282f717-1276-481e-8fb0-dc459c1f3304 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '.version_select at 0x7ff197a178b0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:48.828518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2282f717-1276-481e-8fb0-dc459c1f3304 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306683223" status: 202 len: 0 microversion: 2.1 time: 0.202816 Aug 25 03:14:48.829096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 505/974] 10.222.0.75 () {58 vars in 1218 bytes} [Thu Aug 25 03:14:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306683223 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:14:49.823986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:49.824529 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:49.831181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:49.832214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:49.832648 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:49.833325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:49.833784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:49.834195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:49.849304 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:49.925084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.objects.instance [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'services' on Instance uuid cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 {{(pid=121255) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:50.427530 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-32713b9a-a8b2-4ecc-875e-9e3ea63df04d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments/6d145db1-cc4a-4432-a563-3727fa4f0ae7" status: 202 len: 0 microversion: 2.1 time: 0.607092 Aug 25 03:14:50.428088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 470/975] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:14:49 2022] DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments/6d145db1-cc4a-4432-a563-3727fa4f0ae7 => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:14:50.436953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:50.439117 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:50.446831 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:50.447345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:50.451259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:50.451259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:50.451259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:50.451259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:50.453231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:50.479711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fbad00d8-f29f-41de-9a8c-4d4146948b5f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Aug 25 03:14:50.480377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 506/976] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:14:50 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:51.492345 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:51.494672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:51.502058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:51.502521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:51.514525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:51.514525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:51.514525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:51.514525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:51.535965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5433d6f2-82a0-4c2e-b8b2-f86f256b4f0a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Aug 25 03:14:51.536656 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 471/977] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:14:51 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:14:52.548231 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:52.550473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:52.558981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:52.559472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:52.559911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:52.560659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:52.561115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:52.561554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:52.592913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-13b72eaa-acae-483a-9fff-db2e1a32810d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048746 Aug 25 03:14:52.593750 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 507/978] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:14:52 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:14:52.658661 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:52.662497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:52.666489 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:52.666971 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:52.667404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:52.668091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:52.668571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:52.668996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:52.693886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:14:53.038696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-24c5aa69-7e48-4e3a-9264-74af55937682 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 204 len: 0 microversion: 2.1 time: 0.383628 Aug 25 03:14:53.039321 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 472/979] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:14:52 2022] DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:14:53.047972 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:53.048636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:53.055353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:53.055773 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:53.056228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:53.056916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:53.057370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:53.057788 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:53.186840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:53.195011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7b3f7328-f4a5-4fe4-8861-bbaf14de1e7f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1682 microversion: 2.1 time: 0.151262 Aug 25 03:14:53.197888 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 508/980] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:53 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:14:54.216239 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:54.216889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:54.223318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:54.223957 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:54.225312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:54.226209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:54.226662 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:54.227336 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:54.375298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:54.383381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1ab51e9e-fc72-400a-82fe-115a5c5bade5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1682 microversion: 2.1 time: 0.171415 Aug 25 03:14:54.383944 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 473/981] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:54 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:55.405796 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:55.406629 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:55.409378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:55.414549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:55.415179 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:55.415749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:55.416633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:55.417219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:55.417769 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:55.508977 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16", "name": "network-vif-deleted", "tag": "bcaf3694-63cd-4684-9f00-b8a2d1bf1789"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:55.518222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:55.522583 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:55.523136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:55.524180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:55.535962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5cbc29c3-15ac-4797-877a-68515c6b0b39 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1615 microversion: 2.1 time: 0.132122 Aug 25 03:14:55.535962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 509/982] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:55 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:55.539890 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] Creating event network-vif-deleted:bcaf3694-63cd-4684-9f00-b8a2d1bf1789 for instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 on hv-cinder-77957 Aug 25 03:14:55.551903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-75200d9e-1dc2-438a-b56d-2b2c2ae6f6a6 req-2bd3939d-1f75-494d-b829-4cb1b2abbaba service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047883 Aug 25 03:14:55.553173 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 474/983] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:14:56.559960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:56.559960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:56.565594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:56.566083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:56.567219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:56.567914 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:56.568389 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:56.568820 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:56.603987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:56.605048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:56.605705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:56.606661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'fault' on Instance uuid cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:14:56.666229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:14:56.673616 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6a4cffd5-d8f7-459d-82f6-63d21fb2f33b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 200 len: 1331 microversion: 2.1 time: 0.119728 Aug 25 03:14:56.674249 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 510/984] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:56 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:14:57.701360 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:57.702205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:14:57.704573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:57.709680 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:57.710152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:57.710579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:57.711416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:14:57.711860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:14:57.712305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:14:57.726061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 HTTP/1.1 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:14:57.727639 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:14:57.729024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16'} Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:14:57.729808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:14:57.731315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:14:57.732904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:14:57.732904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f0f9b395-80c2-4297-bd98-8dbebaf92c79 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 404 len: 111 microversion: 2.1 time: 0.031872 Aug 25 03:14:57.732904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 475/985] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:14:57 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:14:57.738035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4e275f42-01e1-4df3-b738-50457e311e92 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '.version_select at 0x7ff197a5be50>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:14:57.925763 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4e275f42-01e1-4df3-b738-50457e311e92 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130132669" status: 202 len: 0 microversion: 2.1 time: 0.191544 Aug 25 03:14:57.926337 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 511/986] 10.222.0.75 () {58 vars in 1221 bytes} [Thu Aug 25 03:14:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1130132669 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:14:58.876215 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b6e3f70-81c8-4159-a5cf-272329c8ee2e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: .version_select at 0x7ff19b3c2280>, body: {"keypair": {"name": "tempest-keypair-804212526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCkWo1ogqqJ2lifxD0erDAqngkYn8WeRmIwKMpK7MxLBIMCk7LqnoQw9ZO4azItzGqwWougqvb5fXeu792bt+NUtnG134OQr++6YFFbqkv9p0Dj3dGxX37DXH/WRZPsUQ=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:14:58.892430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-2b6e3f70-81c8-4159-a5cf-272329c8ee2e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:14:58.896222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-2b6e3f70-81c8-4159-a5cf-272329c8ee2e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:14:59.045623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2b6e3f70-81c8-4159-a5cf-272329c8ee2e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.173377 Aug 25 03:14:59.046606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 476/987] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:14:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:01.693039 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1294201736", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ca25ebd-ab9b-4352-95b3-63248390eeaa"}], "security_groups": [{"name": "tempest-securitygroup--274980685"}], "key_name": "tempest-keypair-804212526", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:01.800353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] validate_networks() for [('1ca25ebd-ab9b-4352-95b3-63248390eeaa', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:15:02.191479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:15:02.191913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:15:02.192593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:15:02.193319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:15:02.194587 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:15:02.206802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:02.207284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:02.207719 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:02.208477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:02.208929 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:02.209980 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:02.228903 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:15:02.233038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:15:02.244569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:15:02.247145 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:15:02.417439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cbdccace-99a8-4aa4-a7c9-792d51a8545e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.729247 Aug 25 03:15:02.418090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 512/988] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:15:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:15:02.430483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-80ade4f5-0120-4e84-a6a5-c50c21b31cbb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:02.431090 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-80ade4f5-0120-4e84-a6a5-c50c21b31cbb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:02.493616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-80ade4f5-0120-4e84-a6a5-c50c21b31cbb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:02.503319 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-80ade4f5-0120-4e84-a6a5-c50c21b31cbb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1241 microversion: 2.1 time: 0.076509 Aug 25 03:15:02.516845 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 477/989] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:02 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:03.528765 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:03.529383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:03.535424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:03.536019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:03.536377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:03.537082 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:03.537653 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:03.538255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:03.603860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:03.611511 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-bd3ad581-9f13-4870-bac4-df39e50a0d58 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1245 microversion: 2.1 time: 0.087257 Aug 25 03:15:03.612053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 513/990] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:03 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:04.633830 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:04.634435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:04.640453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:04.640959 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:04.641399 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:04.642116 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:04.642567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:04.642994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:04.706104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:04.713809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-69c66d55-46cf-4564-bfe9-a213f4e51f0e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1293 microversion: 2.1 time: 0.084982 Aug 25 03:15:04.714363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 478/991] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:04 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:05.734575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:05.735177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:05.742365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:05.742843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:05.743273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:05.743962 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:05.744505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:05.744924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:05.812423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:05.820132 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a19e5936-73f7-4a55-80c7-34188e91a70a tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1299 microversion: 2.1 time: 0.089339 Aug 25 03:15:05.820667 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 514/992] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:05 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:15:06.840959 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:06.841630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:06.848120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:06.848631 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:06.849066 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:06.849891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:06.850364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:06.850790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:06.989320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:06.997680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc892f6-9849-4a47-985a-96b76fe30fd5", "tag": "c645a6b3-b3e8-4587-982c-26550ded0f32"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:07.008922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:07.009432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:07.010062 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:07.012541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1024a035-6579-429d-bfaa-b754bb728ba8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.175282 Aug 25 03:15:07.017956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 479/993] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:06 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:07.023577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] Creating event network-changed:c645a6b3-b3e8-4587-982c-26550ded0f32 for instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 on hv-cinder-77957 Aug 25 03:15:07.035153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-940332fb-be97-4fe6-b2e9-4f735dbb7adc req-7b70328b-e0d0-4a9f-9030-f9c01274c152 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Aug 25 03:15:07.035153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 515/994] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:15:08.036989 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:08.038161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:08.044569 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:08.045045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:08.045473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:08.046168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:08.046620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:08.047043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:08.184180 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:08.192779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d3fa2302-4360-4883-9e5d-598c1f578431 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.159539 Aug 25 03:15:08.193346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 480/995] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:08 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:09.216635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:09.216635 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:09.221521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:09.221994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:09.222424 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:09.223100 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:09.223544 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:09.223964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:09.357463 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:09.365824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e9826c2a-3ac7-4f21-a241-f5459cd60f3f tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.155041 Aug 25 03:15:09.366476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 516/996] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:09 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:10.386980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:10.387590 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:10.394216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:10.394718 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:10.395128 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:10.395814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:10.396316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:10.397571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:10.535685 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:10.544048 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-5ff94c5d-469b-47b2-90be-dd1049c6b465 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.161043 Aug 25 03:15:10.544956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 481/997] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:10 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:11.565390 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:11.565995 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:11.573681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:11.574181 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:11.574596 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:11.575282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:11.575727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:11.576164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:11.710478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:11.718421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-087191cf-cbec-4e25-a52f-8b02dbd6387b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.156866 Aug 25 03:15:11.719138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 517/998] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:11 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:12.378334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc892f6-9849-4a47-985a-96b76fe30fd5", "name": "network-vif-plugged", "status": "completed", "tag": "c645a6b3-b3e8-4587-982c-26550ded0f32"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:12.388575 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:12.389040 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:12.389461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:12.400788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] Creating event network-vif-plugged:c645a6b3-b3e8-4587-982c-26550ded0f32 for instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 on hv-cinder-77957 Aug 25 03:15:12.405730 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-362b287f-40c9-41f0-a4bd-c531ee62334b req-df103d3d-1d76-4bbf-b379-553d0e5e083a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Aug 25 03:15:12.406307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 482/999] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:12.744314 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:12.744933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:12.747213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:12.748031 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:12.753367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:12.753851 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:12.754829 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:12.755536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:12.756777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:12.757209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:12.894922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:12.903435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-170c9a2f-a6ff-4342-9515-50bacc55cc0b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.164695 Aug 25 03:15:12.904018 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 518/1000] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:12 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:13.921815 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:13.926595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:13.927274 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:13.933873 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:13.935467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:13.935467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:13.935467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:13.935872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:13.936332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:14.070992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:14.079204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-60228875-09c0-44af-917f-a5bf6e37c658 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1366 microversion: 2.1 time: 0.158613 Aug 25 03:15:14.079769 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 483/1001] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:13 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:15.105448 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:15.110986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:15.113874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:15.114359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:15.114790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:15.115577 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:15.116076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:15.116519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:15.245302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:15.253258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c952c2d7-0887-487b-b342-fd5b6b5f670b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1556 microversion: 2.1 time: 0.151845 Aug 25 03:15:15.253822 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 519/1002] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:15 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:15.274446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:15.274974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:15.281624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:15.282099 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:15.282533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:15.283200 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:15.283637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:15.284050 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:15.362433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4260ace8-ead1-4ed4-aa15-4d6810fc7f5d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092636 Aug 25 03:15:15.363022 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 484/1003] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:15:15 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:16.424638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fc892f6-9849-4a47-985a-96b76fe30fd5", "tag": "c645a6b3-b3e8-4587-982c-26550ded0f32"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:16.434101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:16.434768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:16.435412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:16.460939 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] Creating event network-changed:c645a6b3-b3e8-4587-982c-26550ded0f32 for instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 on hv-cinder-77957 Aug 25 03:15:16.466124 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-59dec361-c166-405b-8df9-05f4b2cc97e8 req-c8c09d07-af55-443e-a4aa-be2033c617e3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048143 Aug 25 03:15:16.466999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 520/1004] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:46.062034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:46.062849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:46.066755 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:46.067252 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:46.073780 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:46.074269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:46.074732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:46.075452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:46.075904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:46.076357 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:46.099938 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-004ebc15-fe62-4987-9ffc-8b078914b208 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/ips" status: 200 len: 149 microversion: 2.1 time: 0.039254 Aug 25 03:15:46.100537 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 485/1005] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:15:46 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:47.798398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:47.809215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=72 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:15:47.809215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db00ae3c-2225-45c2-b5af-e6bf19268e63"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:47.809215 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:47.812781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:47.813268 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:47.813706 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:47.814401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:47.814859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:47.815294 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:48.733021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ade831a5-eab8-4ad9-a341-e8a3df2f3833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935910 Aug 25 03:15:48.733541 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 521/1006] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:15:47 2022] POST /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:56.258581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db00ae3c-2225-45c2-b5af-e6bf19268e63"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:15:56.260961 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:56.268577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.269046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.269467 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.270138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.270582 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.270995 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.348140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: POST /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments HTTP/1.1 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 74 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:15:56.349874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {"volumeAttachment": {"volumeId": "db00ae3c-2225-45c2-b5af-e6bf19268e63"}} Aug 25 03:15:56.351547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'server_id': '6fc892f6-9849-4a47-985a-96b76fe30fd5', 'body': {'volumeAttachment': {'volumeId': 'db00ae3c-2225-45c2-b5af-e6bf19268e63'}}} Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:15:56.352502 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:15:56.354064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 400 to user: Invalid volume: volume db00ae3c-2225-45c2-b5af-e6bf19268e63 is already attached to instances: 6fc892f6-9849-4a47-985a-96b76fe30fd5 {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ad7fa554-8d6e-42f2-bfcd-cc669fcdc811 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098107 Aug 25 03:15:56.355651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 486/1007] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:15:56 2022] POST /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 25 03:15:56.416948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:56.417521 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:56.423526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.423996 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.424449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.425126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.425571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.425987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.509469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'services' on Instance uuid 6fc892f6-9849-4a47-985a-96b76fe30fd5 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:15:56.837844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b25086cf-3d0e-4ff4-b0b0-7bed86e14dc7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments/db00ae3c-2225-45c2-b5af-e6bf19268e63" status: 202 len: 0 microversion: 2.1 time: 0.425402 Aug 25 03:15:56.838465 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 522/1008] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:15:56 2022] DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments/db00ae3c-2225-45c2-b5af-e6bf19268e63 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:15:56.846806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:56.849020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:56.856879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.862649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.862649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.862649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:56.862649 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:56.863061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:56.889401 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ef9ae4e7-cea8-4c58-8a24-af0b0b5af650 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046504 Aug 25 03:15:56.891265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 487/1009] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:15:56 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:15:57.903632 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:57.906043 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:57.912333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:57.912815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:57.914012 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:57.914711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:57.915281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:57.915708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:57.946168 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ef990ba2-dd90-437d-b6e4-a3732a114594 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047538 Aug 25 03:15:57.946730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 523/1010] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:15:57 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:15:58.012913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:58.013405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:58.019772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:58.020279 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:58.020713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:58.021398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:58.021828 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:58.022366 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:58.047473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:15:58.460939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-03426423-e79e-4ad0-ba20-c446438a0a2c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 204 len: 0 microversion: 2.1 time: 0.451169 Aug 25 03:15:58.461536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 488/1011] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:15:58 2022] DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:15:58.469922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:58.476869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:58.477019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:58.477410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:58.477849 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:58.478544 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:58.478994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:58.479418 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:58.609168 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:58.620066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b20a82c1-b2fd-4236-9cf5-6f3dc99d632c tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1680 microversion: 2.1 time: 0.154143 Aug 25 03:15:58.620675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 524/1012] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:58 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:15:59.642474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:15:59.643166 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:15:59.649770 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:59.650247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:59.650675 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:59.651349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:15:59.651790 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:15:59.652233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:15:59.783760 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:15:59.792024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-69a261a7-17f2-4851-ba49-5cd30e8cf142 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1680 microversion: 2.1 time: 0.153828 Aug 25 03:15:59.792622 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 489/1013] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:15:59 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:00.814151 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:00.814741 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:00.822024 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:00.822509 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:00.822934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:00.823632 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:00.824323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:00.824687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:00.893813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:00.902153 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0d586beb-6f9d-4ef9-87b2-8e40448d2227 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1613 microversion: 2.1 time: 0.091918 Aug 25 03:16:00.902711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 525/1014] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:00 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:01.167940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fc892f6-9849-4a47-985a-96b76fe30fd5", "name": "network-vif-deleted", "tag": "c645a6b3-b3e8-4587-982c-26550ded0f32"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:01.178597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:01.179105 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:01.179537 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:01.190747 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] Creating event network-vif-deleted:c645a6b3-b3e8-4587-982c-26550ded0f32 for instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 on hv-cinder-77957 Aug 25 03:16:01.196491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-4bb10c28-0194-4ac3-844a-353ea2e4b946 req-861a505a-40b9-47a9-8a96-40ff6269d02c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Aug 25 03:16:01.197008 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 490/1015] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:01.940589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:01.940589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:01.940589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:01.940589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:01.941224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:01.941224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:01.941224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:01.941224 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:01.968818 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:01.969310 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:01.969766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:01.970270 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'fault' on Instance uuid 6fc892f6-9849-4a47-985a-96b76fe30fd5 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:16:02.012721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:02.020683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2856a279-d079-4bd1-a69f-02522c6cda53 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 200 len: 1331 microversion: 2.1 time: 0.100561 Aug 25 03:16:02.021250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 526/1016] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:01 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:03.044516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:03.045214 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:03.051276 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:03.051752 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:03.052204 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:03.052885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:03.053334 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:03.054428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:03.067261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 HTTP/1.1 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:16:03.068882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:16:03.070400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '6fc892f6-9849-4a47-985a-96b76fe30fd5'} Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:16:03.071396 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:16:03.073257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:16:03.074745 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:16:03.074745 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1fc813a8-fcb1-43f3-83c5-19f2dc13e434 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 404 len: 111 microversion: 2.1 time: 0.030778 Aug 25 03:16:03.074745 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 491/1017] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:03 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:16:03.079439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-45dccf97-e050-4fd9-83b7-083f88b628bd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '.version_select at 0x7ff19b3208b0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:03.162977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-45dccf97-e050-4fd9-83b7-083f88b628bd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-804212526" status: 202 len: 0 microversion: 2.1 time: 0.087136 Aug 25 03:16:03.164469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 527/1018] 10.222.0.75 () {58 vars in 1218 bytes} [Thu Aug 25 03:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-804212526 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:16:03.923533 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-025b00a5-4e52-46d0-9289-e886c9763df5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: .version_select at 0x7ff19b3c2c10>, body: {"keypair": {"name": "tempest-keypair-1998633894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOJwRhiu39szSeFnZr+/D6vipmlYl3kcn6Bs9plvR/pSJoI4luFv/wCoFGAcEhE2CfgTVPQsxVuiyNP4Fhvgfvhn8tJCEhQOZdTy5kEhpkW11USo0bpvjf+t2TO/y0ALg=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:03.939792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-025b00a5-4e52-46d0-9289-e886c9763df5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:16:03.943589 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-025b00a5-4e52-46d0-9289-e886c9763df5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:16:04.084579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-025b00a5-4e52-46d0-9289-e886c9763df5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.164733 Aug 25 03:16:04.085414 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 492/1019] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:16:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:06.924926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1919363234", "imageRef": "3f4b7868-f7cd-4506-98c4-059347d11d91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ca25ebd-ab9b-4352-95b3-63248390eeaa"}], "security_groups": [{"name": "tempest-securitygroup--1949903068"}], "key_name": "tempest-keypair-1998633894", "user_data": "}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:07.182376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] validate_networks() for [('1ca25ebd-ab9b-4352-95b3-63248390eeaa', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:16:07.554588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:16:07.555022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:16:07.555502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:16:07.555944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:16:07.556385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:16:07.565349 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:07.565989 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:07.566419 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:07.567137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:07.567582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:07.568000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:07.585234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:16:07.589478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Getting quotas for user b67df0ce7f634db48cbd63d2bb0e5631 and project 7d495b3e011c49388cc8cff98aeb1d73. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:16:07.600451 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:16:07.602815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f4b7868-f7cd-4506-98c4-059347d11d91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:16:07.783069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c4804bd7-68a7-42f6-9152-5542ed093b96 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.862434 Aug 25 03:16:07.783716 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 528/1020] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:16:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:16:07.795709 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ddf7fad8-fad6-4ecb-a5c0-5596da796c68 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:07.796426 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ddf7fad8-fad6-4ecb-a5c0-5596da796c68 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:07.959636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ddf7fad8-fad6-4ecb-a5c0-5596da796c68 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:07.966824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ddf7fad8-fad6-4ecb-a5c0-5596da796c68 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1242 microversion: 2.1 time: 0.175800 Aug 25 03:16:07.968610 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 493/1021] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:07 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1242 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:08.989178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:08.989834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:08.997574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:08.998086 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:08.998527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:08.999276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:08.999730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:09.000178 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:09.067126 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:09.075659 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-425f948f-10c3-4fb3-95f8-840e75f30a73 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1246 microversion: 2.1 time: 0.091367 Aug 25 03:16:09.076262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 529/1022] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:08 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:10.096042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:10.096720 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:10.104004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:10.104594 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:10.104981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:10.112462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:10.112462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:10.112462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:10.209270 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:10.218193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-82590410-62c7-4644-9ef7-0e295e8653cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1302 microversion: 2.1 time: 0.126007 Aug 25 03:16:10.218943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 494/1023] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:10 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1302 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:11.240228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:11.241014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:11.247729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:11.248319 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:11.248755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:11.249446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:11.249894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:11.250316 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:11.379607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:11.387486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-094e2197-e7f0-44e5-aea5-17a0d0e0d42d tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.151270 Aug 25 03:16:11.388053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 530/1024] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:11 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:11.818712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bf05ea-81b7-4307-8ef2-da28c40ebf05", "tag": "77f898c3-3841-47d6-94fc-95fe147bb6ac"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:11.830522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:11.831314 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:11.832020 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:11.845233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] Creating event network-changed:77f898c3-3841-47d6-94fc-95fe147bb6ac for instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 on hv-cinder-77957 Aug 25 03:16:11.850309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-cb1dbb50-8efe-4046-a040-179cf6b1b78f req-51a9443e-93db-4361-a449-b258ab01df39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035228 Aug 25 03:16:11.851228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 495/1025] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:12.409749 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:12.410378 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:12.417685 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:12.418173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:12.418598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:12.419324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:12.419774 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:12.420212 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:12.554821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:12.562873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-22cf8678-d149-4071-b43e-2955b0f56318 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.157040 Aug 25 03:16:12.563445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 531/1026] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:12 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:16:13.584138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:13.584865 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:13.591140 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:13.591642 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:13.592070 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:13.592771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:13.593223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:13.593636 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:13.721001 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:13.729107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ed48d405-eeaf-4d80-9075-e4fad99a76b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.149637 Aug 25 03:16:13.729668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 496/1027] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:13 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:14.750519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:14.751227 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:14.757768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:14.758247 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:14.758679 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:14.759956 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:14.760450 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:14.760868 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:14.892410 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:14.900076 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-597c985e-8f56-439f-b942-c61c58dfe5d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.153416 Aug 25 03:16:14.900926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 532/1028] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:14 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:15.920974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:15.921643 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:15.928282 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:15.928771 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:15.929207 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:15.929921 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:15.930371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:15.930934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:16.061931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:16.069552 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-754824a8-2a23-4111-89e5-069b6e513d75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.152449 Aug 25 03:16:16.070115 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 497/1029] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:15 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:17.091315 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:17.091832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:17.098175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:17.098647 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:17.099070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:17.099748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:17.100218 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:17.100638 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:17.227684 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:17.235995 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-995356e0-b553-4926-aed4-5d0dcb2aae33 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.149222 Aug 25 03:16:17.236584 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 533/1030] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:17 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:18.257624 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:18.258152 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:18.260660 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:18.265331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:18.265814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:18.266230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:18.266932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:18.267478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:18.267839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:18.398126 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:18.405736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-4019f631-76e7-4834-8b76-f94585e550ce tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.151991 Aug 25 03:16:18.406302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 498/1031] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:18 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:18.672166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf05ea-81b7-4307-8ef2-da28c40ebf05", "name": "network-vif-plugged", "status": "completed", "tag": "77f898c3-3841-47d6-94fc-95fe147bb6ac"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:18.677352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:18.683115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:18.683115 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:18.684130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:18.684809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:18.685239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:18.688912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:18.695911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] Creating event network-vif-plugged:77f898c3-3841-47d6-94fc-95fe147bb6ac for instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 on hv-cinder-77957 Aug 25 03:16:18.701150 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-25b64e2d-df80-4138-b4ac-00f901d6b72c req-b8664056-e0fd-40e0-b2da-c09abe232a72 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032711 Aug 25 03:16:18.706118 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 534/1032] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:19.427302 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:19.427908 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:19.435094 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:19.435584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:19.436023 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:19.436821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:19.437408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:19.437872 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:19.569939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:19.578859 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c0e66b19-00e9-4f95-bcb1-696e9157c7b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.155798 Aug 25 03:16:19.579415 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 499/1033] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:19 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:20.600542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:20.601210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:20.610281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:20.610762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:20.611198 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:20.611977 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:20.612457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:20.612886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:20.752693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:20.761498 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-61ca0a19-b1bf-41f8-924b-90e0e83d77a5 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1368 microversion: 2.1 time: 0.166214 Aug 25 03:16:20.762070 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 535/1034] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:20 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:21.782175 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:21.782774 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:21.789038 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:21.789508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:21.789932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:21.790607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:21.791143 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:21.791561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:21.928370 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:16:21.936783 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e1c01dbd-941b-4547-b457-7ccc688484d6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1558 microversion: 2.1 time: 0.158516 Aug 25 03:16:21.937377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 500/1035] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:16:21 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:16:21.956881 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:21.957381 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:21.964885 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:21.965355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:21.965783 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:21.966457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:21.966899 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:21.967313 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:22.046794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9a17a920-e830-4257-ac7a-05be85087e4b tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093685 Aug 25 03:16:22.047409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 536/1036] 10.222.0.75 () {58 vars in 1275 bytes} [Thu Aug 25 03:16:21 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:23.283331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50bf05ea-81b7-4307-8ef2-da28c40ebf05", "tag": "77f898c3-3841-47d6-94fc-95fe147bb6ac"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:23.293699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:23.294242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:23.294732 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:23.305266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] Creating event network-changed:77f898c3-3841-47d6-94fc-95fe147bb6ac for instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 on hv-cinder-77957 Aug 25 03:16:23.310614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-0b40a9f8-02aa-469f-88fe-29ba08afe341 req-712360a2-f93c-42f9-8d35-c7cd04d3d0cb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Aug 25 03:16:23.311264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 501/1037] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:16:53.586717 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=5 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:53.587472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=11 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:53.591611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:16:53.592098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:53.598364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:53.598837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:53.599263 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:53.599942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:53.600420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:53.600837 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:53.624713 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-285a1c34-04cd-4b14-bbc0-ba5cc6f3a5cd tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/ips" status: 200 len: 149 microversion: 2.1 time: 0.039766 Aug 25 03:16:53.625280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 537/1038] 10.222.0.75 () {58 vars in 1248 bytes} [Thu Aug 25 03:16:53 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:16:55.243054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 25 03:16:55.247272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:55.247272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:16:55.249301 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d9d0467-e9a6-4543-acff-cbb1b18a18ac"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:16:55.252223 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:16:55.259888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:55.262897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:55.262897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:55.262897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:16:55.262897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:16:55.263284 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:16:56.221021 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1060bbd9-1b87-4180-92e5-a0bedc942141 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "POST /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.979551 Aug 25 03:16:56.221532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 502/1039] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:16:55 2022] POST /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments => generated 194 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:17:03.829836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:03.830328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:03.833566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:17:03.838433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:03.838909 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:03.839339 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:03.840025 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:03.840502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:03.840924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:03.923731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lazy-loading 'services' on Instance uuid 50bf05ea-81b7-4307-8ef2-da28c40ebf05 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:17:04.131104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4edd44e4-39ed-4982-a891-5935d71a3a75 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments/9d9d0467-e9a6-4543-acff-cbb1b18a18ac" status: 202 len: 0 microversion: 2.1 time: 0.304883 Aug 25 03:17:04.131689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 538/1040] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:17:03 2022] DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments/9d9d0467-e9a6-4543-acff-cbb1b18a18ac => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:17:04.141271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:04.144133 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:04.150714 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:04.151216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:04.151623 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:04.152353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:04.152802 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:04.156435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:04.188637 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9c82e0bd-3e2c-4858-a8be-54556f9c1629 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052146 Aug 25 03:17:04.189188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 503/1041] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:17:04 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:17:05.202842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:05.205185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:05.212627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.213106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.213539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.214229 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.214680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.215104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.244745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a4cc5940-226b-4ecc-b87c-b3e05d5a1520 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046184 Aug 25 03:17:05.245293 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 539/1042] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:17:05 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:17:05.305159 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:05.305658 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:05.311926 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.312432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.312862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.313539 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.313980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.314416 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.340531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:17:05.646948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a01315bb-e6c7-478a-8fcf-31c51fbbb833 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 204 len: 0 microversion: 2.1 time: 0.345234 Aug 25 03:17:05.647546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 504/1043] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:17:05 2022] DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:17:05.655735 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:05.660058 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:05.662925 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.663392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.663817 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.664527 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:05.664970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:05.665385 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:05.795200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:17:05.802969 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1ce45b27-0d54-445c-8a15-ad19d1389b1e tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1682 microversion: 2.1 time: 0.151048 Aug 25 03:17:05.803522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 540/1044] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:05 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:17:06.825249 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:06.825928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:06.832364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:06.832837 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:06.833264 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:06.833945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:06.834386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:06.834799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:06.972398 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:17:06.981174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ef078724-c28b-4764-9b18-7f7886ec5437 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1682 microversion: 2.1 time: 0.160187 Aug 25 03:17:06.981733 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 505/1045] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:06 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:17:08.003023 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:08.003643 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:08.013589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:08.014274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:08.014726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:08.015447 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:08.015913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:08.016367 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:08.098201 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67df0ce7f634db48cbd63d2bb0e5631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d495b3e011c49388cc8cff98aeb1d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:17:08.112173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0e23aceb-007c-4ab4-bf70-faca184798e4 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 200 len: 1614 microversion: 2.1 time: 0.113107 Aug 25 03:17:08.112966 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 541/1046] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:07 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 1614 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:17:08.135468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50bf05ea-81b7-4307-8ef2-da28c40ebf05", "name": "network-vif-deleted", "tag": "77f898c3-3841-47d6-94fc-95fe147bb6ac"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:17:08.145102 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:08.145576 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:08.145997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:08.157722 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] Creating event network-vif-deleted:77f898c3-3841-47d6-94fc-95fe147bb6ac for instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 on hv-cinder-77957 Aug 25 03:17:08.166573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-0a4f1ad5-3a0d-4fca-84a9-d592b2ad5055 req-52074ea8-a266-49d5-81de-5036b339bfc8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105753 Aug 25 03:17:08.167179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 506/1047] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:17:09.138055 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:09.138860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:09.146445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:09.146926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:09.147398 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:09.148282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:09.148678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:09.149097 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:09.164322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 HTTP/1.1 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:17:09.165987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:09.167588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '50bf05ea-81b7-4307-8ef2-da28c40ebf05'} Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:09.168432 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:09.169718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:09.170855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:09.170855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7b3a64ff-fad7-4514-91e8-9c2dc8f662f2 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 404 len: 111 microversion: 2.1 time: 0.035756 Aug 25 03:17:09.170855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 542/1048] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:09 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:09.177588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-089c8586-2ed8-42f8-afff-29ba0074e8ee tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '.version_select at 0x7ff19b3a61f0>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:09.297829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-089c8586-2ed8-42f8-afff-29ba0074e8ee tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998633894" status: 202 len: 0 microversion: 2.1 time: 0.124818 Aug 25 03:17:09.298329 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 507/1049] 10.222.0.75 () {58 vars in 1221 bytes} [Thu Aug 25 03:17:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998633894 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 25 03:17:11.402046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:11.402531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:11.408830 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:11.409302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:11.409730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:11.411010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:11.411431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:11.411846 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:11.424665 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 HTTP/1.1 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:17:11.426272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.427675 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '50bf05ea-81b7-4307-8ef2-da28c40ebf05'} Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:11.428597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.430375 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.432004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:11.432004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-18ab951c-9871-416a-a97a-3001954505b6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 404 len: 111 microversion: 2.1 time: 0.029518 Aug 25 03:17:11.432004 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 543/1050] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:17:11 2022] DELETE /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:11.439796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:11.440557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 50bf05ea-81b7-4307-8ef2-da28c40ebf05] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:11.448391 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:11.448721 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:11.450818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:11.451635 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:11.452103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:11.452596 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:11.466453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 HTTP/1.1 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:17:11.468088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.469671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '50bf05ea-81b7-4307-8ef2-da28c40ebf05'} Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:11.470490 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. Aug 25 03:17:11.471893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:11.473280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 50bf05ea-81b7-4307-8ef2-da28c40ebf05 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:11.473280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2b086cd7-6ed6-4a77-b84c-040933b937e6 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05" status: 404 len: 111 microversion: 2.1 time: 0.033636 Aug 25 03:17:11.473280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 508/1051] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:11 2022] GET /compute/v2.1/servers/50bf05ea-81b7-4307-8ef2-da28c40ebf05 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:12.726019 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:12.726514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:12.732795 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.733264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.733689 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.734373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.734815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.735233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.750559 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 HTTP/1.1 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:17:12.752324 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.754567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '6fc892f6-9849-4a47-985a-96b76fe30fd5'} Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:12.755714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.757253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.758505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:12.758505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8644f4ad-eed5-490f-886d-e9c17cb7a6b7 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 404 len: 111 microversion: 2.1 time: 0.031768 Aug 25 03:17:12.758505 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 544/1052] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:17:12 2022] DELETE /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:12.764193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:12.764809 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 6fc892f6-9849-4a47-985a-96b76fe30fd5] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:12.771460 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.771940 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.772408 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.773107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.773553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.773974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.787087 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 HTTP/1.1 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:17:12.788638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.790307 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '6fc892f6-9849-4a47-985a-96b76fe30fd5'} Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:12.791449 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. Aug 25 03:17:12.792952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.794465 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 6fc892f6-9849-4a47-985a-96b76fe30fd5 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:12.794465 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1a05b1fc-eca4-4551-9d0d-97804cf2da95 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5" status: 404 len: 111 microversion: 2.1 time: 0.029737 Aug 25 03:17:12.794465 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 509/1053] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:12 2022] GET /compute/v2.1/servers/6fc892f6-9849-4a47-985a-96b76fe30fd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:12.798522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:12.799010 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:12.805518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.807533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.807533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.807533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.807533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.807946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.821649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c HTTP/1.1 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:17:12.823170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.824834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '2f7427fc-d39b-40c5-b938-2e054cbba63c'} Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:12.825905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.827539 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.829211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:12.829211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e9c5bc85-b815-4344-9900-8615cec11fef tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 404 len: 111 microversion: 2.1 time: 0.029898 Aug 25 03:17:12.829211 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 545/1054] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:17:12 2022] DELETE /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:12.833153 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:12.833759 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: 2f7427fc-d39b-40c5-b938-2e054cbba63c] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:12.839829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.840342 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.840773 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.841475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:12.841918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:12.842333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:12.855504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c HTTP/1.1 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:17:12.859108 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.860573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '2f7427fc-d39b-40c5-b938-2e054cbba63c'} Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:12.861316 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. Aug 25 03:17:12.862849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:12.864807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance 2f7427fc-d39b-40c5-b938-2e054cbba63c could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:12.864807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3bd7ef52-e731-4c7a-a9e6-6b437ca7d8f9 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c" status: 404 len: 111 microversion: 2.1 time: 0.029242 Aug 25 03:17:12.864807 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 510/1055] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:12 2022] GET /compute/v2.1/servers/2f7427fc-d39b-40c5-b938-2e054cbba63c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:14.114802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:14.115295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:14.122080 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:14.122563 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:14.123003 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:14.123693 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:14.124175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:14.124600 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:14.138473 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 HTTP/1.1 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:17:14.140007 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.141552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': 'cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16'} Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:14.142420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.143873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.145338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:14.145338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6167e1e1-694f-4ea6-bed0-ba702a0533cb tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 404 len: 111 microversion: 2.1 time: 0.031081 Aug 25 03:17:14.145338 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 546/1056] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:17:14 2022] DELETE /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:17:14.150132 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:17:14.150766 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] [instance: cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:17:14.157035 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:14.157512 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:14.157942 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:14.158617 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:17:14.159061 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:17:14.159478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:17:14.172600 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] HTTP exception thrown: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Request method failure captured: Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 HTTP/1.1 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBuig3BBosKYkCReLKoVBkF0IQ-oAz1WHoK0nGjN25ErUQzCJuz5tD1GqxqChK4tm8xHFJidh549D9wmez1jrdjCnisb29hL0oc5s-U4o0l19Pq_F-KyJ8zUYiTdt_mDR8kG5hzKsX3VBdt_1v9QsqE9WESlkI5LiEBW7DzVJc5SJP7g Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:17:14.174106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7d495b3e011c49388cc8cff98aeb1d73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7d495b3e011c49388cc8cff98aeb1d73"}]}] Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 7d495b3e011c49388cc8cff98aeb1d73 Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1901515070 Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b67df0ce7f634db48cbd63d2bb0e5631 Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-AttachVolumeNegativeTest-1901515070-project Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.176332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16'} Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:17:14.177247 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. Aug 25 03:17:14.178723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:17:14.180034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] Returning 404 to user: Instance cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:17:14.180034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9ec5f4da-4be2-42c2-8089-3b742bf205b8 tempest-AttachVolumeNegativeTest-1901515070 tempest-AttachVolumeNegativeTest-1901515070-project] 10.222.0.75 "GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16" status: 404 len: 111 microversion: 2.1 time: 0.029109 Aug 25 03:17:14.180034 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 511/1057] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:17:14 2022] GET /compute/v2.1/servers/cdf1493a-2b52-41a5-ab8f-3c3b29ab3a16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:18:20.313912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8dbd537e-bfbb-4c39-ade5-3c44702d5143 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'create', calling method: .version_select at 0x7ff19b30f9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-637649183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGyCZOsyQV9jqYFqieJ3UYy/YID6GET6oAM9gxnJbPT+20KKVRFanqVhlE9Pw1cq/UK5LjgsEsOoy7M9qT5vmK28VXT2A9MFouBHvX1QBB8vfcL8t7YWZmpI3YZ/jSCyQ=="}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:20.320545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=18 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:20.321204 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:20.325756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:18:20.325756 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.75) !!! Aug 25 03:18:20.335799 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-8dbd537e-bfbb-4c39-ade5-3c44702d5143 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Getting quotas for project 1e9654067eab44baaac7631bf9e2fc9a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:18:20.339878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-8dbd537e-bfbb-4c39-ade5-3c44702d5143 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Getting quotas for user bcff78c2fee849979692402ae298cbd3 and project 1e9654067eab44baaac7631bf9e2fc9a. Resources: {'key_pairs'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:18:20.444289 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8dbd537e-bfbb-4c39-ade5-3c44702d5143 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.134787 Aug 25 03:18:20.444921 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 547/1058] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:18:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:20.496054 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:20.498602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:20.500777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-639544288", "imageRef": "071c08ec-9c39-43b4-aa14-5f0beecb9f4f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-637649183", "networks": [{"uuid": "88788d37-168f-4f9c-9669-9e892ec0d538"}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:20.552292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] validate_networks() for [('88788d37-168f-4f9c-9669-9e892ec0d538', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:18:21.031849 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:18:21.032312 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:18:21.032839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:18:21.033187 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:18:21.033595 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:18:21.043335 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:21.043810 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:21.044289 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:21.045011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:21.045462 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:21.045882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:21.062541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Getting quotas for project 1e9654067eab44baaac7631bf9e2fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:18:21.066333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Getting quotas for user bcff78c2fee849979692402ae298cbd3 and project 1e9654067eab44baaac7631bf9e2fc9a. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:18:21.078170 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:18:21.080469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='071c08ec-9c39-43b4-aa14-5f0beecb9f4f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:18:21.217914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-53c8a329-8dc2-4c92-b830-e920b82654a2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723692 Aug 25 03:18:21.218551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 512/1059] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:18:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:18:21.229491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-70bd50df-826c-4e8c-8cd9-4f78929928a5 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:21.230123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-70bd50df-826c-4e8c-8cd9-4f78929928a5 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:21.288392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-70bd50df-826c-4e8c-8cd9-4f78929928a5 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:21.296106 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-70bd50df-826c-4e8c-8cd9-4f78929928a5 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1257 microversion: 2.1 time: 0.070539 Aug 25 03:18:21.296696 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 548/1060] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:21 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:22.319745 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0abd8bf3-dbb2-457d-869a-29482010bfd9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:22.320542 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0abd8bf3-dbb2-457d-869a-29482010bfd9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:22.376735 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0abd8bf3-dbb2-457d-869a-29482010bfd9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:22.384565 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0abd8bf3-dbb2-457d-869a-29482010bfd9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1257 microversion: 2.1 time: 0.070471 Aug 25 03:18:22.385052 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 513/1061] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:22 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:23.406011 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:23.406813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:23.414908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:23.415544 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:23.416123 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:23.416983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:23.417530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:23.417987 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:23.483388 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:23.491715 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-35e55201-bc62-431b-92e4-f82f0cdbe8d7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1309 microversion: 2.1 time: 0.089995 Aug 25 03:18:23.492318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 549/1062] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:23 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:24.513698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:24.514464 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:24.523127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:24.523879 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:24.524587 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:24.525626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:24.526322 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:24.526956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:24.752634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:24.761820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0d0e944e-abb0-489d-b522-d5659b717372 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.252740 Aug 25 03:18:24.762405 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 514/1063] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:24 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:25.787682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:25.788543 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:25.794905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:25.803264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:25.803264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:25.803264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:25.803264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:25.803730 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:25.943141 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:25.951299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c30002ef-d29e-4c1a-80ba-8df7919a11cf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.167976 Aug 25 03:18:25.958138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 550/1064] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:25 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:26.972679 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:26.973407 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:26.981107 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:26.981601 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:26.982038 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:26.982745 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:26.983193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:26.983616 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:27.129074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:27.137541 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7de41c20-222c-4e44-b4e2-c5c8838e7deb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.168628 Aug 25 03:18:27.138443 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 515/1065] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:26 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:28.158900 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:28.159637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:28.166214 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:28.166727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:28.167176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:28.167871 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:28.168352 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:28.168797 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:28.310148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:28.319177 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-7bc4e925-a01f-415b-86fa-f2fcb00f52a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.163280 Aug 25 03:18:28.320228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 551/1066] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:28 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:29.341004 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:29.341647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:29.348064 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:29.348620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:29.349056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:29.350387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:29.350826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:29.351250 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:29.489966 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:29.499826 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a388dbd7-7f13-4a7c-9a41-13805e8653aa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.162751 Aug 25 03:18:29.500713 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 516/1067] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:29 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:30.522093 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:30.523065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:30.530311 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:30.530794 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:30.531228 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:30.531924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:30.532401 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:30.532821 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:30.669190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:30.679217 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-43225150-a95f-4e58-983d-e7b885f3230a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.162083 Aug 25 03:18:30.680175 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 552/1068] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:30 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:31.700881 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:31.701483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:31.703889 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:31.709298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:31.709779 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:31.710211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:31.710988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:31.711429 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:31.718777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:31.850893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:31.858895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3e0002fc-d535-4611-8d0c-e7cb42232470 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.162023 Aug 25 03:18:31.859463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 517/1069] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:31 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:32.882331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:32.882940 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:32.884829 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:32.890022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:32.894697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:32.894697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:32.894697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:32.894697 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:32.895104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:33.030623 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:33.038955 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0be5abfd-430f-4522-9443-c49a7b2805fa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.161720 Aug 25 03:18:33.039798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 553/1070] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:32 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:33.235375 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:33.242168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=8 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:33.246009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:33.246476 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:33.246897 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:33.258939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] Creating event network-changed:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:18:33.264057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-605fe54a-ed7d-4ce7-a8e2-a95edd5ed9eb req-723c0c3a-8971-436a-964d-76e2d4d8aed7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Aug 25 03:18:33.267409 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 518/1071] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:34.060802 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:34.061510 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:34.063691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:18:34.063840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:18:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 (ip 10.222.0.75) !!! Aug 25 03:18:34.072325 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:34.072812 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:34.073250 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:34.073983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:34.074437 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:34.074913 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:34.214183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:34.222836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c6934aa7-122c-4d80-9cfb-843628e6badf tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.165626 Aug 25 03:18:34.222836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 554/1072] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:34 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:35.244525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:35.245209 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:35.251733 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:35.252241 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:35.252668 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:35.253338 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:35.253780 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:35.254194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:35.383062 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:35.390543 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-35e9693e-6d59-468e-9d2c-3a7b76ebf93d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.151153 Aug 25 03:18:35.391096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 519/1073] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:35 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:36.412269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:36.412959 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:36.419332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:36.419813 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:36.420273 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:36.420964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:36.421415 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:36.421839 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:36.552960 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:36.560544 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-aa9b3fb6-d57b-4a66-90c6-c3b56646feea tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.152745 Aug 25 03:18:36.561107 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 555/1074] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:36 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:37.581814 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:37.582551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:37.589373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:37.589846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:37.590267 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:37.590943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:37.591387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:37.591832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:37.720871 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:37.729292 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c1159276-0618-462a-b716-fb0a23055507 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.151260 Aug 25 03:18:37.729882 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 520/1075] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:37 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:18:38.750723 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:38.751355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:38.758359 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:38.758834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:38.759261 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:38.759945 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:38.760423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:38.760842 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:38.886048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:38.893678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5d8a07ae-4cff-4b16-ad91-a8e13c12d789 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.146849 Aug 25 03:18:38.894235 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 556/1076] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:38 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:39.548011 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "name": "network-vif-plugged", "status": "completed", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:39.558574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:39.559048 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:39.559468 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:39.571372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] Creating event network-vif-plugged:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:18:39.577261 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-f9686fd6-00d7-4020-bc20-a8157ea12d9e req-6d36e813-51d4-40cf-827e-52480081c4d1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150630 Aug 25 03:18:39.577874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 521/1077] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:18:39.914721 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:39.915327 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:39.922072 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:39.922554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:39.922983 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:39.923682 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:39.924170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:39.924620 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:40.062360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:40.064532 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-026a01b9-c913-4134-9925-9ef05c1d28d4 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.154089 Aug 25 03:18:40.065098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 557/1078] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:39 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:41.086846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:41.087579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:41.094194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:41.094673 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:41.095105 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:41.095788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:41.096266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:41.096692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:41.232811 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:41.241053 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-d7fb218d-fa0a-4996-84ae-88a8b47fdb6d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1357 microversion: 2.1 time: 0.158956 Aug 25 03:18:41.241628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 522/1079] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:41 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:42.261191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:42.261758 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:42.268172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.268663 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.269091 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.269768 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.270209 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.270625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.399165 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:42.407063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a9398fb7-0626-4362-8a45-dcbdd5eec918 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1548 microversion: 2.1 time: 0.149846 Aug 25 03:18:42.407624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 558/1080] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:42 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:42.429796 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:42.430440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:42.437056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.437538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.437974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.438665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.439119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.439540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.572670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:42.580437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-c1e12836-f4fd-4a22-bad0-604cdaa18058 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1548 microversion: 2.1 time: 0.155281 Aug 25 03:18:42.580996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 523/1081] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:42 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:42.601363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:42.606069 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:42.606727 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Searching by: {'deleted': False, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a'} {{(pid=121256) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 25 03:18:42.613331 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.613805 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.614238 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.615499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.615944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.616395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.706999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.multi_cell_list [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121256) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 25 03:18:42.800077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4746bed0-19b4-42c4-9265-758773b9047d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203315 Aug 25 03:18:42.800607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 559/1082] 10.222.0.75 () {58 vars in 1125 bytes} [Thu Aug 25 03:18:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:42.812746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:42.813343 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:42.819968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.820471 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.820899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.821620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:42.822065 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:42.822508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:42.951067 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:42.958946 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e2c422d3-e568-4b68-ad9a-ee7a38e56626 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1548 microversion: 2.1 time: 0.150002 Aug 25 03:18:42.959561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 524/1083] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:42 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:44.873720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67fc0e99-43c0-4803-ab51-36f8eb27a647"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:44.876096 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:44.883219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:44.891542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:44.891542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:44.891542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:44.891542 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:44.891938 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:45.661652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e4569a98-1a95-48bc-b440-22b1aead11a6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791538 Aug 25 03:18:45.662272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 560/1084] 10.222.0.75 () {60 vars in 1323 bytes} [Thu Aug 25 03:18:44 2022] POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:53.235283 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:53.235886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:53.238491 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:53.239431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=60 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:53.244417 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:53.244894 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:53.245325 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:53.246007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:53.246456 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:53.246876 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:53.381841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:53.390658 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-309e3e0e-6e83-4bac-bb77-7ebb041c38a8 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1594 microversion: 2.1 time: 0.159204 Aug 25 03:18:53.391557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 525/1085] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:53 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:18:55.623022 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:55.623937 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:55.624562 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:18:55.628791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:55.640213 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:55.640688 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:55.641137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:55.657436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] Creating event network-changed:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:18:55.662811 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-35a20822-3d2c-474d-b3ae-8af9080e79ef req-c68abd64-843e-44b9-8ae3-374977fadf43 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040983 Aug 25 03:18:55.663420 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 561/1086] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:18:58.487348 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1032052152"}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:58.488104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:58.494968 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:58.495478 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:58.495912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:58.496634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:58.497195 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:58.497504 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:58.629317 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.network.security_group_api [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Adding security group 3ac5a5ad-68bf-45cf-b739-2d1d23d08237 to port 8df62484-18fa-4c20-a294-4f739cde77b0 Aug 25 03:18:59.020089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-30cfb104-dfdb-46ba-a12f-1173294b3afa tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.536985 Aug 25 03:18:59.025945 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 526/1087] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:18:58 2022] POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:18:59.029974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:18:59.035354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:18:59.035499 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:18:59.037373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:59.037952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:59.038378 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:59.039063 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:59.039507 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:59.039974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:59.056287 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:18:59.056761 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:18:59.057395 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:18:59.080993 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] Creating event network-changed:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:18:59.085832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-314ab28c-86bd-4e76-be7e-2e5ac4c95fad req-0ac90237-21b9-494a-8e56-5e6235463913 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061152 Aug 25 03:18:59.086433 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 562/1088] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:18:59.296520 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:18:59.305041 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-18784d8d-63a5-4116-86b9-433f810f637a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1760 microversion: 2.1 time: 0.278765 Aug 25 03:18:59.319484 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 527/1089] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:18:59 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:13.276994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:13.279309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:13.286953 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.287428 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.287854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.288943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.289399 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.289843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.559198 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9eac2708-659a-469e-a320-74bd7e5aa61d tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.286857 Aug 25 03:19:13.559943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 563/1090] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:19:13 2022] POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:19:13.568573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:13.569174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:13.571142 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:13.571816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=16 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:13.576743 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.580030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.580030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.580030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:13.580030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:13.580412 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:13.771324 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:13.780415 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e5f243a7-8f86-4b4b-932c-40f4798ff249 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1752 microversion: 2.1 time: 0.215808 Aug 25 03:19:13.781046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 528/1091] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:13 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1752 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:14.802780 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:14.803492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:14.809567 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.810044 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.810538 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:14.811222 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:14.811678 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:14.812102 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:15.179951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:15.188503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-93f81a81-6b5f-4ab2-b8d0-0abcc9b4cb3b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.390360 Aug 25 03:19:15.189065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 564/1092] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:14 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:16.210832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:16.211369 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:16.218181 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.218681 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.219084 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.219764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:16.220242 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:16.220662 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:16.363220 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:16.371585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-948e2a44-1e9e-4d5a-9921-10b5c68c545a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.164810 Aug 25 03:19:16.372154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 529/1093] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:16 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:19:17.392504 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:17.393172 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:17.399113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.399593 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:17.400027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:17.400738 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:17.401190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:17.401617 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:17.544056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:17.553046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-04eb9e6a-1285-45ef-bf8e-f0c1a727a3d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.164573 Aug 25 03:19:17.553610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 565/1094] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:17 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:18.574707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:18.575313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:18.581914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:18.582403 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.582834 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:18.583525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:18.583978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:18.584435 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:18.723169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:18.731387 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-8feeb73b-3bea-4b85-8aa0-5663a217bf7b tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.160600 Aug 25 03:19:18.731953 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 530/1095] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:18 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:19.754291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:19.754882 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:19.761443 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.761923 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.762355 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.763042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:19.763491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:19.763907 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:19.904705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:19.912911 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-cb1875db-a1de-449c-a31a-002f0ccbb2d9 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.163434 Aug 25 03:19:19.913474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 566/1096] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:19 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:20.934370 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:20.935059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:20.941419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.941891 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.942311 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:20.942980 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:20.943419 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:20.943832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:21.088237 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:21.097272 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e64a06fe-cd30-4428-925c-bcd6364d2939 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.166732 Aug 25 03:19:21.104278 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 531/1097] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:20 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:22.117884 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:22.118497 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:22.125000 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.125486 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.126423 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.127116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:22.127569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:22.127994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:22.271908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:22.280064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5ba353e1-f9fa-4e79-bc85-669232eb20e2 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.166028 Aug 25 03:19:22.282288 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 567/1098] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:22 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:23.301353 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:23.301948 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:23.308420 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.308892 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.309318 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.309992 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:23.310432 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:23.310846 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:23.458480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:23.466200 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6ea12cfd-ae4d-419e-bd80-f3c68b824cbd tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.169300 Aug 25 03:19:23.466753 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 532/1099] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:23 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:24.487457 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:24.488345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:24.494889 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.495369 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.495800 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.496522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:24.496968 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:24.497390 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:24.638143 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:24.647255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-30f516a5-b417-497e-a0ca-93335904bb18 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1757 microversion: 2.1 time: 0.164310 Aug 25 03:19:24.647826 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 568/1100] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:24 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:25.669191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:25.677818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:25.677818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.677818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.677818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.678240 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:25.678503 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:25.678919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:25.824784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:19:25.833895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-077e1515-7701-484c-8078-75775d63dbbe tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1760 microversion: 2.1 time: 0.168509 Aug 25 03:19:25.834482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 533/1101] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:19:25 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:19:58.024271 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1032052152"}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:58.024828 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:58.027109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=16 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:58.027776 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:58.032785 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.033267 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.033707 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.034394 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.034840 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.035342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.163342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.network.security_group_api [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Removing security group 3ac5a5ad-68bf-45cf-b739-2d1d23d08237 from port 8df62484-18fa-4c20-a294-4f739cde77b0 Aug 25 03:19:58.544191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6787d1b0-829d-421c-82c3-2d798bb91402 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action" status: 202 len: 0 microversion: 2.1 time: 0.522934 Aug 25 03:19:58.547485 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 569/1102] 10.222.0.75 () {60 vars in 1278 bytes} [Thu Aug 25 03:19:58 2022] POST /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:19:58.561106 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=12 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:58.562728 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=36 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:19:58.649666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:19:58.659538 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:58.660010 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:58.660619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:58.672911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] Creating event network-changed:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:19:58.678741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-6989bf70-d561-4c4b-83c4-0cfec83f0bea req-2455de9a-5966-4757-8463-6bbf405e2981 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130657 Aug 25 03:19:58.679893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 534/1103] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:19:59.958373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:19:59.958908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:19:59.965109 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.965583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.966013 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:19:59.966686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:19:59.967181 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:19:59.967598 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.062931 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lazy-loading 'services' on Instance uuid 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:20:00.301859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-1c906487-0054-4bbc-841b-94f8ee82dd21 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments/67fc0e99-43c0-4803-ab51-36f8eb27a647" status: 202 len: 0 microversion: 2.1 time: 0.347806 Aug 25 03:20:00.302683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 570/1104] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:19:59 2022] DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments/67fc0e99-43c0-4803-ab51-36f8eb27a647 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:20:00.312482 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:00.315031 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:00.321723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.322206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.322630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.323320 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.323772 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.324219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.354792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-03a74414-2d03-450d-b668-8f692709f3c1 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 25 03:20:00.355597 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 535/1105] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:20:00 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:00.694522 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:00.705702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:00.706176 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:00.706597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:00.717784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] Creating event network-changed:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:20:00.723253 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-a6b17c1f-41fb-4bcc-98db-9e03db34b541 req-26764a5d-5e33-406c-a4be-af0799d3c836 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033058 Aug 25 03:20:00.723847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 571/1106] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:01.368612 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:01.371258 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:01.378410 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:01.385585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:01.385585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.385585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:01.385585 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:01.385979 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:01.410364 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b231231d-43f1-4eb4-b301-cc144612184c tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045775 Aug 25 03:20:01.410925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 536/1107] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:20:01 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:02.424748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:02.426943 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:02.433042 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.433516 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.433948 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.434630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.435078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.435501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.463744 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-025a823d-0f48-4014-9d2a-33c839652ebb tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044827 Aug 25 03:20:02.464323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 572/1108] 10.222.0.75 () {58 vars in 1302 bytes} [Thu Aug 25 03:20:02 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 25 03:20:02.475388 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:02.475913 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:02.482305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.482783 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.483211 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.485046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:02.485500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:02.485928 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:02.562893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] HTTP exception thrown: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 is not attached to volume 67fc0e99-43c0-4803-ab51-36f8eb27a647 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Request method failure captured: Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments/67fc0e99-43c0-4803-ab51-36f8eb27a647 HTTP/1.1 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBunqmv6KXHU0TIXNFqkj4Ix-GpqT5bH73xkjZAi-CU7jwH46duETcRTDIV8ADiKRaAadi3xhGB_Au9KTml8Yxo9KHr_jxVD69i-9IC0akaSSbmd4KM0DmLWsKf5uUU6dsZdKh-3jtZhjG3sPgOvugZdwesYBqDW5pAUxgO4pVoN0H_g Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 1e9654067eab44baaac7631bf9e2fc9a Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:20:02.565309 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1e9654067eab44baaac7631bf9e2fc9a"}]}] Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 1e9654067eab44baaac7631bf9e2fc9a Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestMinimumBasicScenario-682455796-project Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: bcff78c2fee849979692402ae298cbd3 Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestMinimumBasicScenario-682455796-project Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:20:02.566984 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 is not attached to volume 67fc0e99-43c0-4803-ab51-36f8eb27a647 Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'server_id': '8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8', 'id': '67fc0e99-43c0-4803-ab51-36f8eb27a647'} Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 67fc0e99-43c0-4803-ab51-36f8eb27a647. Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:02.567932 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 is not attached to volume 67fc0e99-43c0-4803-ab51-36f8eb27a647 Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 is not attached to volume 67fc0e99-43c0-4803-ab51-36f8eb27a647 Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:02.569518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Returning 404 to user: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 is not attached to volume 67fc0e99-43c0-4803-ab51-36f8eb27a647 {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:02.570703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-269a724a-9812-48c3-9fbd-3b3722765ea6 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments/67fc0e99-43c0-4803-ab51-36f8eb27a647" status: 404 len: 154 microversion: 2.1 time: 0.095354 Aug 25 03:20:02.570703 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 537/1109] 10.222.0.75 () {58 vars in 1416 bytes} [Thu Aug 25 03:20:02 2022] DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8/os-volume_attachments/67fc0e99-43c0-4803-ab51-36f8eb27a647 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:20:03.864482 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:03.864998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:03.871239 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.871714 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.872164 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.872847 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:03.873291 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:03.873709 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:03.898322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:20:04.221779 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9e421402-792d-49da-a4c0-02e8f13bfc0a tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 204 len: 0 microversion: 2.1 time: 0.361101 Aug 25 03:20:04.222377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 573/1110] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:20:03 2022] DELETE /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:20:04.230739 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:04.231380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:04.238328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.241450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.241450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.241450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:04.241450 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:04.241857 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:04.372813 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:04.380742 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9a4ca830-4a63-4f62-995d-6210d97f7903 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1554 microversion: 2.1 time: 0.154068 Aug 25 03:20:04.381308 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 538/1111] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:04 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:05.404844 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:05.405535 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:05.412613 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:05.413099 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:05.413530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:05.414223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:05.414668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:05.415090 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:05.545191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:05.552976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3e4d3b21-caab-481b-be38-a66d117c43a7 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1554 microversion: 2.1 time: 0.152333 Aug 25 03:20:05.553548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 574/1112] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:05 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:06.428163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8", "name": "network-vif-deleted", "tag": "8df62484-18fa-4c20-a294-4f739cde77b0"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:06.438265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.441556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.441556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.450024 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] Creating event network-vif-deleted:8df62484-18fa-4c20-a294-4f739cde77b0 for instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 on hv-cinder-77957 Aug 25 03:20:06.455715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-5a2e93df-c93e-45f5-a045-c0e9e83c0b3a req-881b604a-5d2e-4d1d-aeed-7a7cab74d002 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031201 Aug 25 03:20:06.456333 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 539/1113] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:06.575998 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:06.576633 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:06.583282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.583751 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.584210 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.584897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:06.585389 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:06.585755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:06.652284 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcff78c2fee849979692402ae298cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e9654067eab44baaac7631bf9e2fc9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:06.660964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-2bd10425-cb89-48d8-bca5-4525a7646159 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 200 len: 1342 microversion: 2.1 time: 0.089104 Aug 25 03:20:06.661630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 575/1114] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:06 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:07.684373 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:07.685074 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] [instance: 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:07.691233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.691711 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.692169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.692859 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:07.693310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:07.693731 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:07.706862 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] HTTP exception thrown: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Request method failure captured: Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 HTTP/1.1 Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBunqmv6KXHU0TIXNFqkj4Ix-GpqT5bH73xkjZAi-CU7jwH46duETcRTDIV8ADiKRaAadi3xhGB_Au9KTml8Yxo9KHr_jxVD69i-9IC0akaSSbmd4KM0DmLWsKf5uUU6dsZdKh-3jtZhjG3sPgOvugZdwesYBqDW5pAUxgO4pVoN0H_g Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 1e9654067eab44baaac7631bf9e2fc9a Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:20:07.708497 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1e9654067eab44baaac7631bf9e2fc9a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1e9654067eab44baaac7631bf9e2fc9a"}]}] Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 1e9654067eab44baaac7631bf9e2fc9a Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestMinimumBasicScenario-682455796 Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestMinimumBasicScenario-682455796-project Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: bcff78c2fee849979692402ae298cbd3 Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestMinimumBasicScenario-682455796-project Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. Aug 25 03:20:07.710072 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8'} Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:20:07.710917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. Aug 25 03:20:07.712428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:20:07.713970 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Returning 404 to user: Instance 8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:20:07.713970 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1c191061-d25a-4476-a83c-132062cf29e0 tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8" status: 404 len: 111 microversion: 2.1 time: 0.030557 Aug 25 03:20:07.713970 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 540/1115] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:07 2022] GET /compute/v2.1/servers/8555c0c7-a7c1-4553-95ec-c6f4be7bf7d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:20:07.718345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-d468865d-d268-4630-a746-7781a367f06f tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] Calling method '.version_select at 0x7ff197abf700>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:07.839503 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-d468865d-d268-4630-a746-7781a367f06f tempest-TestMinimumBasicScenario-682455796 tempest-TestMinimumBasicScenario-682455796-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-637649183" status: 202 len: 0 microversion: 2.1 time: 0.124831 Aug 25 03:20:07.840077 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 576/1116] 10.222.0.75 () {58 vars in 1269 bytes} [Thu Aug 25 03:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-637649183 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 25 03:20:30.047721 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:20:30.048378 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Thu Aug 25 03:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.75) !!! Aug 25 03:20:30.049768 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:20:30.049886 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Thu Aug 25 03:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.75) !!! Aug 25 03:20:30.051976 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=14 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:30.052855 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=30 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:30.223667 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6c9f91d1-42f2-45a0-9cc2-faabb79d6df5 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Action: 'create', calling method: .version_select at 0x7ff193b90790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-814321191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEXf9EyfbtMthbRn6HgUaWjRjLPs17gY5dwacPt/5jnflOCeWwHBvW1kBk+wejBKtOSw+Mr0lfkoQZn1JaiyfdwzdY2zQpuSB/EAIyZBBpWULcPfGUkx6FAYTCn74stzA=="}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:30.240818 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-6c9f91d1-42f2-45a0-9cc2-faabb79d6df5 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for project 0bb0777527214f059e031c3b484a2eb1. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:20:30.244628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-6c9f91d1-42f2-45a0-9cc2-faabb79d6df5 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for user b841ba312a6e4b919719c3166248c149 and project 0bb0777527214f059e031c3b484a2eb1. Resources: {'key_pairs'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:20:30.319518 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6c9f91d1-42f2-45a0-9cc2-faabb79d6df5 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.277471 Aug 25 03:20:30.320134 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 541/1117] 10.222.0.75 () {60 vars in 1159 bytes} [Thu Aug 25 03:20:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:48.491087 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:48.491864 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:48.495767 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-297421387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814321191", "security_groups": [{"name": "tempest-secgroup-smoke-621624000"}], "block_device_mapping_v2": [{"uuid": "267d06b8-9b15-475d-a16b-66fc2e12786e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd"}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:48.609860 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] validate_networks() for [('4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:20:49.070050 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:20:49.070476 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:20:49.070951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:20:49.071361 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:20:49.071770 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:20:49.080518 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.080999 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.081439 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:49.082160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:49.082607 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:49.083035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:49.100560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:20:49.104517 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for user b841ba312a6e4b919719c3166248c149 and project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:20:49.161718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:20:49.164572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='267d06b8-9b15-475d-a16b-66fc2e12786e',volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:20:49.595276 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e896757a-b7fb-4ab2-a265-15c4263380a7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.106851 Aug 25 03:20:49.595964 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 577/1118] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:20:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:20:49.604440 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:49.606653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:49.609109 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-77d4f050-b4cf-43a6-bcda-1f4263b9ae96 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:49.609707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-77d4f050-b4cf-43a6-bcda-1f4263b9ae96 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:49.668988 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-77d4f050-b4cf-43a6-bcda-1f4263b9ae96 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:49.676457 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-77d4f050-b4cf-43a6-bcda-1f4263b9ae96 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1093 microversion: 2.1 time: 0.073378 Aug 25 03:20:49.677033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 542/1119] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:49 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:50.697873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-906b915f-9187-4bf4-ac96-757fb3171842 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:50.698492 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-906b915f-9187-4bf4-ac96-757fb3171842 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:50.750985 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-906b915f-9187-4bf4-ac96-757fb3171842 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:50.757982 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-906b915f-9187-4bf4-ac96-757fb3171842 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1093 microversion: 2.1 time: 0.064755 Aug 25 03:20:50.758553 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 578/1120] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:50 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:51.778748 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-947147d9-3e45-485f-bdb5-73a29ae1add0 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:51.779359 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-947147d9-3e45-485f-bdb5-73a29ae1add0 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:51.832327 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-947147d9-3e45-485f-bdb5-73a29ae1add0 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:51.839867 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-947147d9-3e45-485f-bdb5-73a29ae1add0 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1093 microversion: 2.1 time: 0.065320 Aug 25 03:20:51.840470 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 543/1121] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:51 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:52.862064 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-45dde565-303c-42a9-8656-03fd64b4eb8e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:52.862594 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-45dde565-303c-42a9-8656-03fd64b4eb8e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:52.920531 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-45dde565-303c-42a9-8656-03fd64b4eb8e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:52.927392 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-45dde565-303c-42a9-8656-03fd64b4eb8e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1093 microversion: 2.1 time: 0.069599 Aug 25 03:20:52.928290 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 579/1122] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:52 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:53.949688 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:53.950657 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:53.957007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.957492 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.957927 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:53.958619 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:53.959073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:53.959499 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:54.022911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:54.031890 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-89a8edec-14e4-471d-956f-d853d28c8103 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1143 microversion: 2.1 time: 0.086905 Aug 25 03:20:54.032521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 544/1123] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:53 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:55.052636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:55.053285 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:55.060092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.060601 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.061036 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.061737 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:55.062190 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:55.062793 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:55.126533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:55.135200 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b152c437-de91-412d-a18d-6b015f723c11 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1135 microversion: 2.1 time: 0.086390 Aug 25 03:20:55.135772 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 580/1124] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:55 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1135 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:20:56.156033 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:56.156784 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:56.164800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.165381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.170536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.170536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:56.170536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:56.170536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:56.246571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:56.255269 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fe7f77cf-b93c-4bc5-97f8-f9beb655a969 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1209 microversion: 2.1 time: 0.102954 Aug 25 03:20:56.255854 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 545/1125] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:56 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:57.279298 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:57.280583 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:57.287332 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.287574 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.288005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.288755 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.289199 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.289687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.391472 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9a2602-9471-4825-93c1-7adbec0cc61f", "tag": "20720b17-2eba-43c0-8065-e7a64678fc3f"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:20:57.405574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:57.405931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:57.406219 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:57.422457 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] Creating event network-changed:20720b17-2eba-43c0-8065-e7a64678fc3f for instance 5a9a2602-9471-4825-93c1-7adbec0cc61f on hv-cinder-77957 Aug 25 03:20:57.428752 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:57.436870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-5744c991-7950-494d-b385-59278ee75cb6 req-76c422fd-53b5-4465-97f7-2a54c2d880b8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040788 Aug 25 03:20:57.436870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 546/1126] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:20:57.437762 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-0a6e5e4a-ed31-40ce-86d4-d11f8e0b5601 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.162799 Aug 25 03:20:57.453255 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 581/1127] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:57 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:58.459801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:58.460663 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:58.467996 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.468508 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.468943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.469989 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:58.470096 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:58.470510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:58.602916 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:58.611199 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-fc52b57f-6ca5-4d6f-8646-1b2746986cd9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.155982 Aug 25 03:20:58.611885 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 547/1128] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:58 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:20:59.633088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:20:59.633731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:20:59.636196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:20:59.641170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.641657 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.642094 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:59.642823 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:20:59.643274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:20:59.643705 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:20:59.777049 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:20:59.784801 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-293417d8-f3e7-4d6a-ac9a-e27835769e10 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.155538 Aug 25 03:20:59.785377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 582/1129] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:20:59 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:00.806058 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:00.806697 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:00.813340 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:00.813820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:00.814257 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:00.814939 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:00.815397 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:00.815819 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:00.946841 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:00.954526 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ed1e20f3-c405-40ac-a2c0-34edd0872574 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.153052 Aug 25 03:21:00.955124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 548/1130] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:00 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:01.974922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:01.975552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:01.982912 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:01.983323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:01.983748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:01.984464 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:01.984905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:01.985571 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:02.114667 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:02.122519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-96b9b13b-a459-4248-a96e-36918e0144c3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.151430 Aug 25 03:21:02.123083 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 583/1131] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:01 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:03.143226 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:03.143808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:03.146013 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=4 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:03.151888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:03.152402 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:03.152840 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:03.153525 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:03.153973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:03.154400 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:03.287029 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:03.295917 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6d3871bb-852f-4d56-8f8a-89f0ed64bb1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.156520 Aug 25 03:21:03.296561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 549/1132] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:03 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:04.319021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:04.319610 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:04.322269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=10 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:21:04.327466 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:04.327947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:04.328408 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:04.329108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:04.329557 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:04.330046 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:04.459373 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:04.467766 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8df16a89-8a24-432d-862c-f664d7928292 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.152718 Aug 25 03:21:04.468363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 584/1133] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:04 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:05.488271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:05.488904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:05.495599 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.496073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.496553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.497233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:05.497682 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:05.498103 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:05.627820 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:05.636571 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2e7bd9de-a8da-4932-a28a-8ee210a4b72a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.152395 Aug 25 03:21:05.637131 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 550/1134] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:05 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:06.657353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:06.657949 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:06.665258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:06.665809 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:06.666303 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:06.667014 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:06.667461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:06.667886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:06.800982 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:06.808878 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ba5af978-eb5f-4c06-b6b4-b6cc68506a29 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.155354 Aug 25 03:21:06.809449 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 585/1135] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:06 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:07.830178 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:07.830803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:07.837994 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:07.838474 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:07.838912 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:07.839602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:07.840082 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:07.840531 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:07.975733 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:07.983715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-39650a75-b7d4-423e-abcb-a12cc04639ef tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.157481 Aug 25 03:21:07.984361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 551/1136] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:07 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:08.205303 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9a2602-9471-4825-93c1-7adbec0cc61f", "name": "network-vif-plugged", "status": "completed", "tag": "20720b17-2eba-43c0-8065-e7a64678fc3f"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:08.215710 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:08.220896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:08.220896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:08.227757 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] Creating event network-vif-plugged:20720b17-2eba-43c0-8065-e7a64678fc3f for instance 5a9a2602-9471-4825-93c1-7adbec0cc61f on hv-cinder-77957 Aug 25 03:21:08.232902 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-c42f255e-c724-40ca-a87b-a1d2c63dd672 req-94e6e2c8-272a-4e5f-9dc0-fd60357a492a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031259 Aug 25 03:21:08.233478 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 586/1137] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:21:09.006904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:09.007998 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:09.016089 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.016593 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.017025 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.017699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:09.018142 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:09.018561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:09.202461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:09.210130 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9ec73184-2756-4622-944e-25b01696ea63 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1264 microversion: 2.1 time: 0.207802 Aug 25 03:21:09.211288 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 552/1138] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:09 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:21:10.232585 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:10.233191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:10.239502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.239976 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.240430 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.241104 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.241547 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.241963 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.424233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:10.432085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8c6ed395-3319-46f3-b856-37fbbf496a1e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1451 microversion: 2.1 time: 0.204352 Aug 25 03:21:10.432681 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 587/1139] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:10 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1451 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:10.452911 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:21:10.453540 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:21:10.459787 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.460300 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.461567 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.462245 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:10.462694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:10.463113 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:10.592459 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:21:10.600303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-dbeaecdb-cadb-4a89-b37c-be92ee84e996 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1451 microversion: 2.1 time: 0.151153 Aug 25 03:21:10.600866 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 553/1140] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:21:10 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:21:12.567874 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a9a2602-9471-4825-93c1-7adbec0cc61f", "tag": "20720b17-2eba-43c0-8065-e7a64678fc3f"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:21:12.578782 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:21:12.579252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:21:12.579676 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:21:12.592112 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] Creating event network-changed:20720b17-2eba-43c0-8065-e7a64678fc3f for instance 5a9a2602-9471-4825-93c1-7adbec0cc61f on hv-cinder-77957 Aug 25 03:21:12.597092 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-62a18721-a55d-4c2c-8ddb-db6c6792b2cf req-0c648093-87b4-4bf9-bd75-4e2ec4e249eb service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032859 Aug 25 03:21:12.597859 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 588/1141] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:07.679230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4d276d14-bff1-4609-8319-42979b4c52bb] AMQP server on 10.222.0.75:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 25 03:23:07.680027 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=28 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:07.680778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=56 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:07.685740 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:07.686225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:07.692258 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:07.695015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:07.695015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:07.695015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:07.695015 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:07.695430 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:07.722045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:23:08.020584 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a5b183f0-f050-4d9c-b361-6848a558e4b8 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 204 len: 0 microversion: 2.1 time: 0.342956 Aug 25 03:23:08.021174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 554/1142] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:23:07 2022] DELETE /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:23:08.027625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdb17f60-4a15-4da7-85cf-38d833dfd725] AMQP server on 10.222.0.75:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 03:23:08.028246 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:08.028992 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=48 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:08.030188 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 25 03:23:08.030328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:23:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f (ip 10.222.0.75) !!! Aug 25 03:23:08.036088 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:08.036838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:08.043729 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:08.044236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:08.044673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:08.045364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:08.045815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:08.046258 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:08.188887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:08.196720 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6badbed1-8319-43cf-805f-97b59550a723 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1576 microversion: 2.1 time: 0.170914 Aug 25 03:23:08.197300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 589/1143] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:08 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:09.219114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:09.219724 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:09.229168 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:09.230055 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:09.230816 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:09.231776 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:09.232255 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:09.232712 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:09.238194 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] [4d276d14-bff1-4609-8319-42979b4c52bb] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 35438. Aug 25 03:23:09.370132 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:09.377746 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a8995451-15b0-4261-982a-34a507e5b20a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1576 microversion: 2.1 time: 0.163025 Aug 25 03:23:09.378303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 555/1144] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:09 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:10.398919 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:10.400345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:10.408581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:10.409071 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:10.409566 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:10.410282 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:10.410734 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:10.411156 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:10.417454 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdb17f60-4a15-4da7-85cf-38d833dfd725] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 35442. Aug 25 03:23:10.478974 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:10.487207 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-8d8d7e12-f5f4-403b-a0be-da2c50115148 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1509 microversion: 2.1 time: 0.092184 Aug 25 03:23:10.487781 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 590/1145] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:10 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1509 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:10.819112 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a9a2602-9471-4825-93c1-7adbec0cc61f", "name": "network-vif-deleted", "tag": "20720b17-2eba-43c0-8065-e7a64678fc3f"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:10.830629 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:10.831536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:10.832059 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:10.851397 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] Creating event network-vif-deleted:20720b17-2eba-43c0-8065-e7a64678fc3f for instance 5a9a2602-9471-4825-93c1-7adbec0cc61f on hv-cinder-77957 Aug 25 03:23:10.857506 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-460d7860-1219-47c9-a51c-ef40f9aee58c req-cc1bdd47-a228-4555-b6d6-848f09eb72d5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100173 Aug 25 03:23:10.858124 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 556/1146] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:23:11.509374 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:11.510651 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:11.519514 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:11.520283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:11.520726 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:11.521532 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:11.522251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:11.522897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:11.553854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:11.554364 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:11.554798 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:11.555236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lazy-loading 'fault' on Instance uuid 5a9a2602-9471-4825-93c1-7adbec0cc61f {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:23:11.598017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:11.606468 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f3568ea9-97e0-45fd-baf3-70a9722d7c2e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 200 len: 1229 microversion: 2.1 time: 0.101264 Aug 25 03:23:11.607085 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 591/1147] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:11 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:12.628371 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:12.629147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:12.636303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:12.636986 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:12.637628 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:12.638315 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:12.638756 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:12.639169 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:12.653298 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] HTTP exception thrown: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Request method failure captured: Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f HTTP/1.1 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBup3fIwEETysrsFr984NSI_XlCu88njTW1QHCVhe3ICEmIvVAiKpnAuUsmBFvJcJnR8yFexVqhr6IP_oRBLrzV4YNV-tLAcd8srBWMfiEFLSXg7RhVgzZhzd_xnM06nZ5DsqQn6mpPYQjUPnqfJzgCY-qOZVY1Q0koaNvBRkzS-i1LY Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:23:12.654930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0bb0777527214f059e031c3b484a2eb1"}]}] Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestVolumeBootPattern-222743624 Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b841ba312a6e4b919719c3166248c149 Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:23:12.656785 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '5a9a2602-9471-4825-93c1-7adbec0cc61f'} Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:23:12.657978 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:23:12.659651 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:23:12.665606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Returning 404 to user: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:23:12.665606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-00233184-07fc-441c-ad18-d68d2c76c3a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 404 len: 111 microversion: 2.1 time: 0.032786 Aug 25 03:23:12.665606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 557/1148] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:12 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:23:12.705479 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1278738824", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814321191", "security_groups": [{"name": "tempest-secgroup-smoke-621624000"}], "block_device_mapping_v2": [{"uuid": "267d06b8-9b15-475d-a16b-66fc2e12786e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd"}]}} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:12.818491 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.network.neutron [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] validate_networks() for [('4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd', None, None, None, None, None)] {{(pid=121256) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:23:13.185440 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:23:13.185854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image limits 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:23:13.186318 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:23:13.186724 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image pref 0:0:0 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:23:13.187142 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.virt.hardware [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121256) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:23:13.196759 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:13.197233 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:13.197668 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:13.198445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:13.198886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:13.199302 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:13.216021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:23:13.219894 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.quota [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for user b841ba312a6e4b919719c3166248c149 and project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121256) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:23:13.276954 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Going to run 1 instances... {{(pid=121256) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:23:13.279074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='267d06b8-9b15-475d-a16b-66fc2e12786e',volume_size=None,volume_type=None)] {{(pid=121256) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:23:13.685748 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b3b0c73d-03b0-4590-b24c-bcac21f16d7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984097 Aug 25 03:23:13.686409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 592/1149] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:23:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:23:13.697588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-0dabf9df-7643-4e50-a5ce-dd72e025c089 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:13.698225 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-0dabf9df-7643-4e50-a5ce-dd72e025c089 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:13.761546 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-0dabf9df-7643-4e50-a5ce-dd72e025c089 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:13.768861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-0dabf9df-7643-4e50-a5ce-dd72e025c089 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1094 microversion: 2.1 time: 0.075337 Aug 25 03:23:13.769437 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 558/1150] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:13 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:14.790363 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:14.791554 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:14.798110 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:14.803708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:14.803708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:14.803708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:14.803708 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:14.804127 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:14.863212 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:14.871312 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-5e5b6969-eb44-4000-bbb3-23c3eae444bf tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1144 microversion: 2.1 time: 0.085262 Aug 25 03:23:14.898348 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 593/1151] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:14 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:15.892205 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:15.892974 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:15.901498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:15.902057 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:15.902557 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:15.903453 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:15.903966 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:15.904480 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:15.977991 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:15.988179 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-1ea7ab47-1404-4ad5-8c0c-a9d8d45d0a92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1200 microversion: 2.1 time: 0.099716 Aug 25 03:23:15.988806 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 559/1152] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:15 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:23:17.017933 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:17.018545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:17.025114 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:17.025637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:17.026191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:17.026904 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:17.027357 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:17.027790 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:17.170339 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:17.178370 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f0ceb7a0-fe5b-46ff-8cb2-b5668899b8e7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1277 microversion: 2.1 time: 0.164421 Aug 25 03:23:17.178942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 594/1153] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:17 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:17.488789 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb65a89a-eefb-47cd-9338-1adebe2707f0", "tag": "4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:17.499190 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:17.499674 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:17.500102 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:17.511516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] Creating event network-changed:4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4 for instance cb65a89a-eefb-47cd-9338-1adebe2707f0 on hv-cinder-77957 Aug 25 03:23:17.516786 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-6f3ce35f-2cd9-4242-9ed6-40b606c208d0 req-bc58b35c-c6cb-4984-988d-39b2c1c74ca8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 Aug 25 03:23:17.517406 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 560/1154] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:23:18.200775 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:18.201384 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:18.207836 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:18.208369 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:18.208807 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:18.209502 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:18.209952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:18.210376 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:18.339445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:18.347133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9977ef13-fa42-41d8-b65c-a91ddf2499d4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.150853 Aug 25 03:23:18.347695 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 595/1155] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:18 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:19.370127 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:19.370847 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:19.377222 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:19.377696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:19.378120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:19.378791 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:19.379230 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:19.379641 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:19.519516 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:19.528341 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-6e3d2a54-0a89-4310-8b22-47838885ed7f tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.163337 Aug 25 03:23:19.528907 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 561/1156] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:19 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:20.549434 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:20.550066 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:20.556649 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:20.557125 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:20.557605 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:20.558280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:20.558745 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:20.559160 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:20.696365 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:20.704412 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-f85a3896-eef5-4299-8956-ae72d1846b86 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.158755 Aug 25 03:23:20.704986 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 596/1157] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:20 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:21.725397 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:21.726003 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:21.733000 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:21.733473 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:21.733895 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:21.734573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:21.735014 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:21.735428 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:21.867909 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:21.875672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7d109301-ed2a-45cf-890a-dc8773d465e6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.154114 Aug 25 03:23:21.876239 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 562/1158] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:21 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:22.897170 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:22.897784 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:22.904674 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:22.905148 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:22.905575 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:22.906251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:22.906692 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:22.907108 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:23.035038 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:23.043461 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-b36e6afe-81ec-474c-ad93-1ecef8b78b3a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.150127 Aug 25 03:23:23.044027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 597/1159] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:22 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:24.065433 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:24.065997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:24.068446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:24.073313 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:24.073904 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:24.074350 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:24.075043 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:24.075495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:24.075918 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:24.209362 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:24.217664 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-333d2d45-a81d-4317-9300-c26ab300429c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.156203 Aug 25 03:23:24.218227 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 563/1160] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:24 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:23:25.238725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:25.239330 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:25.241183 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:25.241850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=6 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:23:25.247264 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:25.268952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:25.268952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:25.268952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:25.268952 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:25.269360 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:25.383702 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:25.392031 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-602c263e-f071-4916-9ef7-19af2e75f1c9 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.157142 Aug 25 03:23:25.392687 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 598/1161] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:25 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:26.413760 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:26.414365 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:26.421536 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:26.422016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:26.422452 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:26.423138 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:26.423588 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:26.424007 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:26.564821 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:26.572549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b7b8a271-120e-481f-8ffd-53da94310b38 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.162671 Aug 25 03:23:26.573113 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 564/1162] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:26 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:27.593281 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:27.593850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:27.600196 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:27.600680 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:27.601116 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:27.601804 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:27.602251 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:27.602691 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:27.735322 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:27.743081 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ce8509bb-adfa-4aca-8ef9-2256c008b856 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.154366 Aug 25 03:23:27.743654 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 599/1163] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:27 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:28.763310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:28.763903 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:28.770676 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:28.771147 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:28.771579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:28.772290 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:28.772736 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:28.773156 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:28.927265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:28.927265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-7ffc3afe-ec3c-4ebd-87e9-5f6d52edfb1a tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.161731 Aug 25 03:23:28.927265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 565/1164] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:28 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:28.936445 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb65a89a-eefb-47cd-9338-1adebe2707f0", "name": "network-vif-plugged", "status": "completed", "tag": "4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:28.945886 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:28.946353 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:28.946777 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:28.957905 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] Creating event network-vif-plugged:4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4 for instance cb65a89a-eefb-47cd-9338-1adebe2707f0 on hv-cinder-77957 Aug 25 03:23:28.962887 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-29b59868-bd61-4a98-ad23-eb8147956213 req-971ba62f-81c2-4edf-9ab9-48f025cec200 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041164 Aug 25 03:23:28.967552 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 600/1165] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 25 03:23:29.942032 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:29.942670 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:29.949659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:29.950131 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:29.950561 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:29.951243 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:29.951692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:29.952114 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:30.091354 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:30.099139 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-b56bfff7-85af-497a-ae59-1c6af8f49dbc tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1265 microversion: 2.1 time: 0.160993 Aug 25 03:23:30.099707 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 566/1166] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:29 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:31.122150 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:31.122838 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:31.128994 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.129515 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.129946 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.130627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.131079 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.131501 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.264016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:31.271662 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-c174af00-bc50-46b2-a3c2-e16282257698 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1453 microversion: 2.1 time: 0.155006 Aug 25 03:23:31.272245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 601/1167] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:31 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:31.291310 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:23:31.291914 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:23:31.298870 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.299347 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.299778 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.300495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:31.300941 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:31.301361 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:31.433606 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:23:31.442049 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a49b954f-bd1e-4b3c-b849-3a2c938b715e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1453 microversion: 2.1 time: 0.154519 Aug 25 03:23:31.442618 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 567/1168] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:23:31 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:23:34.051589 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb65a89a-eefb-47cd-9338-1adebe2707f0", "tag": "4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:23:34.061549 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:23:34.062017 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:23:34.062438 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:23:34.073295 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] Creating event network-changed:4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4 for instance cb65a89a-eefb-47cd-9338-1adebe2707f0 on hv-cinder-77957 Aug 25 03:23:34.078641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-7d282f7a-838b-40ad-b586-d2a452ccc0b8 req-3fb3b0da-6f41-4307-abfa-978e408abc0d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031052 Aug 25 03:23:34.079309 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 602/1169] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:10.506805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:10.507626 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:10.508777 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:25:10.508920 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Thu Aug 25 03:25:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.75) !!! Aug 25 03:25:10.509883 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:25:10.510028 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Thu Aug 25 03:25:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.75) !!! Aug 25 03:25:10.515727 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1269995307", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-814321191", "security_groups": [{"name": "tempest-secgroup-smoke-621624000"}], "block_device_mapping_v2": [{"uuid": "3d16e4a1-0a3e-41e1-9ef9-6c7dbc1bf86a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd"}]}} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:10.638042 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.network.neutron [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] validate_networks() for [('4dab8b6e-50d5-42e6-bbf4-e7f0e04afcdd', None, None, None, None, None)] {{(pid=121255) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 25 03:25:11.090925 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 25 03:25:11.091286 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image limits 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 25 03:25:11.091791 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Flavor pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 25 03:25:11.092232 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Image pref 0:0:0 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 25 03:25:11.092672 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.virt.hardware [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121255) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 25 03:25:11.101551 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:11.102030 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:11.102715 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:11.103431 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:11.103874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:11.104332 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:11.120899 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 25 03:25:11.125016 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.quota [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Getting quotas for user b841ba312a6e4b919719c3166248c149 and project 0bb0777527214f059e031c3b484a2eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=121255) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 25 03:25:11.182757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Going to run 1 instances... {{(pid=121255) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 25 03:25:11.185121 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d16e4a1-0a3e-41e1-9ef9-6c7dbc1bf86a',volume_size=None,volume_type=None)] {{(pid=121255) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 25 03:25:11.613832 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e4036d1d-3530-4d31-b578-62e3c4777627 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.108806 Aug 25 03:25:11.614547 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 568/1170] 10.222.0.75 () {60 vars in 1147 bytes} [Thu Aug 25 03:25:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 25 03:25:11.624526 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bdb17f60-4a15-4da7-85cf-38d833dfd725] AMQP server on 10.222.0.75:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 25 03:25:11.626053 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:11.626822 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=74 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:11.632232 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-596d3d28-e6f7-4c12-b205-90374e83e0d6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:11.632910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-596d3d28-e6f7-4c12-b205-90374e83e0d6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:11.929005 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-596d3d28-e6f7-4c12-b205-90374e83e0d6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:11.936048 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-596d3d28-e6f7-4c12-b205-90374e83e0d6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1094 microversion: 2.1 time: 0.313694 Aug 25 03:25:11.936648 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 603/1171] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:11 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1094 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:12.957144 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:12.965331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:12.965331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:12.965331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:12.965331 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:12.966163 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:12.966696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:12.967121 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:13.039104 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:13.047118 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-cca8e867-ff96-45d8-a0e9-c40c5baf6d15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1192 microversion: 2.1 time: 0.094328 Aug 25 03:25:13.047689 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 569/1172] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:12 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:14.069673 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:14.070301 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:14.083848 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] [bdb17f60-4a15-4da7-85cf-38d833dfd725] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 35616. Aug 25 03:25:14.086504 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:14.086988 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:14.087421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:14.088129 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:14.088597 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:14.089016 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:14.156570 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:14.168446 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9753391a-b5e0-4122-8e69-1079df6aae0c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1210 microversion: 2.1 time: 0.103234 Aug 25 03:25:14.169219 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 604/1173] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:14 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:15.122683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0826d4d9-a9cc-4085-99d8-4168d30489d8", "tag": "7391d703-d865-43fb-97f9-1cbc932d56e5"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:15.133788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:15.134262 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:15.134686 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:15.149161 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] Creating event network-changed:7391d703-d865-43fb-97f9-1cbc932d56e5 for instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 on hv-cinder-77957 Aug 25 03:25:15.155046 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-bb78f955-1bb4-4345-85ea-f9bfd42ad9a4 req-2921358c-06b0-4ca1-b768-c6b0e1770705 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037041 Aug 25 03:25:15.156088 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 570/1174] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:15.191098 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:15.191711 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:15.200643 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:15.201274 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:15.201869 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:15.203157 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:15.204191 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:15.204926 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:15.359347 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:15.370021 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-86902572-3a13-494a-bb91-5e964414805c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.182693 Aug 25 03:25:15.371582 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 605/1175] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:15 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:16.394860 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:16.395553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:16.401905 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:16.402381 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:16.402805 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:16.403510 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:16.403952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:16.404409 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:16.544463 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:16.552372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-f6ba00b2-e3e2-4abb-813f-0e3ec6459d5b tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.162119 Aug 25 03:25:16.552983 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 571/1176] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:16 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:17.573661 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:17.574437 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:17.580824 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:17.581300 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:17.581759 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:17.582441 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:17.583269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:17.583694 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:17.718588 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:17.726259 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-ed147a38-2704-4bb2-83ea-e1f0be6f547c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.156453 Aug 25 03:25:17.726854 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 606/1177] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:17 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:18.748495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:18.749175 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:18.755764 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:18.756280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:18.756723 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:18.757421 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:18.757874 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:18.758301 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:18.893469 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:18.901265 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9e8b7afa-6797-4763-af1d-449180232376 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.157626 Aug 25 03:25:18.902439 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 572/1178] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:18 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:19.923130 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:19.923725 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:19.930922 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:19.931409 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:19.931834 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:19.932561 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:19.933137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:19.941269 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:20.070671 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:20.078656 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-4b59ef26-2ecd-4d22-a508-5d5d0513c45d tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.159573 Aug 25 03:25:20.079223 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 607/1179] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:19 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:21.098956 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:21.099573 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:21.106671 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:21.107150 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:21.107580 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:21.108305 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:21.108757 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:21.109177 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:21.112136 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=2 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:21.133446 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell0:SELECT=6 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:21.254380 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:21.263119 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-9720b30b-400a-4557-88d8-0a095b376f15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.167968 Aug 25 03:25:21.263694 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 573/1180] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:21 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:22.284641 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:22.285245 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:22.287627 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell0:SELECT=2 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:25:22.292500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:22.292981 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:22.293413 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:22.294103 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:22.294548 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:22.294965 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:22.430928 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:22.439421 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-aa65c01a-2b9f-4f88-b142-1a74b8a01174 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.158850 Aug 25 03:25:22.441815 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 608/1181] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:22 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:23.460930 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:23.461532 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:23.469461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.469952 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.470386 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.471092 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:23.471549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:23.471973 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:23.608692 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:23.617323 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-22144a1b-3e96-4c76-83df-0aaf390845db tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.160342 Aug 25 03:25:23.618647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 574/1182] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:23 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:24.638272 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:24.639027 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:24.645569 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:24.646035 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:24.646472 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:24.647173 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:24.647624 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:24.648047 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:24.790581 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:24.796236 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-26d4e5cc-904d-4c59-8467-cc834a4fcc6e tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.162101 Aug 25 03:25:24.797484 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 609/1183] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:24 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:25.643861 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0826d4d9-a9cc-4085-99d8-4168d30489d8", "name": "network-vif-plugged", "status": "completed", "tag": "7391d703-d865-43fb-97f9-1cbc932d56e5"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:25.654117 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:25.654749 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:25.655191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:25.666801 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] Creating event network-vif-plugged:7391d703-d865-43fb-97f9-1cbc932d56e5 for instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 on hv-cinder-77957 Aug 25 03:25:25.672306 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-99a05b86-77d7-4fd0-9b30-8f6c70079a3d req-b620db59-b4aa-4b64-8904-576c8793c6ac service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143683 Aug 25 03:25:25.672919 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 575/1184] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:25:25.818435 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:25.819054 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:25.826411 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:25.826908 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:25.827342 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:25.832880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:25.832880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:25.832880 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:25.965672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:25.973630 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a3140077-f44f-43d6-bdb8-66a599fed460 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.159204 Aug 25 03:25:25.974280 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 610/1185] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:25 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:27.001234 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:27.002137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:27.009800 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:27.010271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:27.010698 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:27.011630 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:27.012073 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:27.012522 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:27.151982 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:27.160044 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2791d1c1-4f48-48c7-9a2e-9590c9ac52de tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1265 microversion: 2.1 time: 0.164382 Aug 25 03:25:27.160645 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 576/1186] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:26 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:28.182260 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:28.183431 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:28.189460 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.189944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.190383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.191073 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.191520 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.191942 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.326166 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:28.334111 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-a1b841da-27ce-4948-85ee-1f8838f107b3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1453 microversion: 2.1 time: 0.156951 Aug 25 03:25:28.334672 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 611/1187] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:28 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:28.355196 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:25:28.355901 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:25:28.362217 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.362691 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.363117 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.363788 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:28.364266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:28.364683 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:28.493741 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:25:28.502368 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e5597fdf-243b-44c5-a2c3-ae958f2e4241 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1453 microversion: 2.1 time: 0.151753 Aug 25 03:25:28.502965 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 577/1188] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:25:28 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:25:30.518652 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0826d4d9-a9cc-4085-99d8-4168d30489d8", "tag": "7391d703-d865-43fb-97f9-1cbc932d56e5"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:25:30.528374 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:25:30.533467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:25:30.533467 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:25:30.540203 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] Creating event network-changed:7391d703-d865-43fb-97f9-1cbc932d56e5 for instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 on hv-cinder-77957 Aug 25 03:25:30.545896 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-31feee43-42ce-4ccf-ae52-1ec1f8de0e43 req-c56ddbc8-8984-49cf-ab2e-98b9e844758d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099228 Aug 25 03:25:30.546508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 612/1189] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:02.148893 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:02.150521 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG dbcounter [-] [121255] Writing DB stats nova_cell1:SELECT=48 {{(pid=121255) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:02.151252 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_api:SELECT=22 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:02.152135 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG dbcounter [-] [121256] Writing DB stats nova_cell1:SELECT=50 {{(pid=121256) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:27:02.153185 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:27:02.153323 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.75) !!! Aug 25 03:27:02.154333 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 25 03:27:02.154469 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Thu Aug 25 03:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.75) !!! Aug 25 03:27:02.159960 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:02.160553 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:02.162351 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0826d4d9-a9cc-4085-99d8-4168d30489d8", "tag": "7391d703-d865-43fb-97f9-1cbc932d56e5"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:02.169448 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.170189 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.170699 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.174036 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.174634 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.174843 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.175235 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.175363 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.175667 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.186858 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] Creating event network-changed:7391d703-d865-43fb-97f9-1cbc932d56e5 for instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 on hv-cinder-77957 Aug 25 03:27:02.192573 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-cf8714e4-2c4a-4b6b-8946-62260e742634 req-bea224f1-cf9f-4d53-a6d9-73a9a003c5f3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043199 Aug 25 03:27:02.193636 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 613/1190] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:02.205605 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Going to try to terminate instance {{(pid=121255) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:02.602792 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-314c7150-87c1-47cc-8b55-81bb9a6d7f54 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 204 len: 0 microversion: 2.1 time: 0.455595 Aug 25 03:27:02.603696 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 578/1191] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:02 2022] DELETE /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:02.613474 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:02.614299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:02.621867 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.622560 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.623074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.623850 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:02.624426 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:02.624934 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:02.829536 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:02.839924 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-6306d6af-4878-411a-ba66-b41e75b6f825 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1577 microversion: 2.1 time: 0.231412 Aug 25 03:27:02.840760 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 614/1192] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:02 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:03.867413 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:03.868574 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:03.875545 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.883078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.883078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:03.883078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:03.883078 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:03.883500 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.070726 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:04.078607 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-3d091a73-e34c-46e7-8a38-34447188a8af tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1459 microversion: 2.1 time: 0.217146 Aug 25 03:27:04.079183 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 579/1193] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:03 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:04.807159 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0826d4d9-a9cc-4085-99d8-4168d30489d8", "name": "network-vif-deleted", "tag": "7391d703-d865-43fb-97f9-1cbc932d56e5"}]} {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:04.817855 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:04.818377 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:04.818870 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:04.831305 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.compute.server_external_events [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] Creating event network-vif-deleted:7391d703-d865-43fb-97f9-1cbc932d56e5 for instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 on hv-cinder-77957 Aug 25 03:27:04.836436 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [req-4a21f32c-a3a1-40be-8ab8-df5bf2b06bf7 req-f808e38e-0bfc-480c-b492-f4d79cd310ad service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Aug 25 03:27:04.837078 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 615/1194] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:05.099824 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:05.100517 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:05.107475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:05.107969 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:05.108611 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:05.109210 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:05.109659 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:05.110280 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:05.184799 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:05.193653 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-e37ed7b4-1342-49d1-abc6-030c29ffaca6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1225 microversion: 2.1 time: 0.098452 Aug 25 03:27:05.194233 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 580/1195] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:05 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:06.215852 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:06.216545 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:06.223065 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.230283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.230283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.230283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.230283 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.230731 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.257791 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:06.258265 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:06.258701 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:06.259137 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lazy-loading 'fault' on Instance uuid 0826d4d9-a9cc-4085-99d8-4168d30489d8 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:06.302477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:06.310572 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-fcde959b-3b29-40b4-886c-15dbc5e751a3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 200 len: 1230 microversion: 2.1 time: 0.099583 Aug 25 03:27:06.311133 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 616/1196] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:06 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:07.337549 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:07.338197 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 0826d4d9-a9cc-4085-99d8-4168d30489d8] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:07.350556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.351045 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.351483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.352206 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:07.352665 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:07.353091 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:07.367647 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] HTTP exception thrown: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Request method failure captured: Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 HTTP/1.1 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBup3fIwEETysrsFr984NSI_XlCu88njTW1QHCVhe3ICEmIvVAiKpnAuUsmBFvJcJnR8yFexVqhr6IP_oRBLrzV4YNV-tLAcd8srBWMfiEFLSXg7RhVgzZhzd_xnM06nZ5DsqQn6mpPYQjUPnqfJzgCY-qOZVY1Q0koaNvBRkzS-i1LY Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:27:07.369349 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0bb0777527214f059e031c3b484a2eb1"}]}] Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b841ba312a6e4b919719c3166248c149 Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. Aug 25 03:27:07.372579 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '0826d4d9-a9cc-4085-99d8-4168d30489d8'} Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:07.374377 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. Aug 25 03:27:07.378009 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:07.381422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Returning 404 to user: Instance 0826d4d9-a9cc-4085-99d8-4168d30489d8 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:07.381422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-a17d6cf4-ea9f-4b54-af73-77e9c4f604f6 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8" status: 404 len: 111 microversion: 2.1 time: 0.037250 Aug 25 03:27:07.381422 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 581/1197] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:07 2022] GET /compute/v2.1/servers/0826d4d9-a9cc-4085-99d8-4168d30489d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:10.921634 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:10.922192 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:10.925120 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb65a89a-eefb-47cd-9338-1adebe2707f0", "tag": "4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:10.933733 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:10.934437 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:10.934876 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.935591 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:10.936063 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:10.936530 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.940803 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:10.941303 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:10.941934 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:10.956602 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] Creating event network-changed:4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4 for instance cb65a89a-eefb-47cd-9338-1adebe2707f0 on hv-cinder-77957 Aug 25 03:27:10.961888 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-9d7e0da6-c00b-46b1-8a3e-9b5c0cc719b0 req-f137eeab-02c3-40ce-8299-17385a4312a4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043634 Aug 25 03:27:10.962760 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 582/1198] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:10.967873 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Going to try to terminate instance {{(pid=121256) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 25 03:27:11.410686 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-e1e9e968-c176-47d8-bd90-8cf98bb736d7 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 204 len: 0 microversion: 2.1 time: 0.497488 Aug 25 03:27:11.411299 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 617/1199] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:10 2022] DELETE /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 25 03:27:11.420461 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:11.421495 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:11.428808 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.429483 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.429997 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.430798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:11.431328 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:11.431829 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:11.620193 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.policy [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121255) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:11.628556 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-ff019ea1-af9f-4ee6-9a15-423e4125f39c tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1578 microversion: 2.1 time: 0.212579 Aug 25 03:27:11.629154 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 583/1200] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:11 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:12.650477 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:12.651383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:12.658718 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.660947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.660947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:12.660947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:12.660947 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:12.661508 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:13.053345 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:13.061832 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-04416442-2668-4549-b0ca-df920da79ea3 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1459 microversion: 2.1 time: 0.415460 Aug 25 03:27:13.062622 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 618/1201] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:12 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1459 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 25 03:27:13.464943 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb65a89a-eefb-47cd-9338-1adebe2707f0", "name": "network-vif-deleted", "tag": "4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4"}]} {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 25 03:27:13.475404 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:13.475981 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:13.476489 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:13.490394 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.compute.server_external_events [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] Creating event network-vif-deleted:4f3d5c0a-70ff-4eec-ad92-b99c1f1443f4 for instance cb65a89a-eefb-47cd-9338-1adebe2707f0 on hv-cinder-77957 Aug 25 03:27:13.495581 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [req-01b7fdd9-7f4d-4cd4-ba12-148787846a3d req-c9e9d120-7d3e-48be-8cf5-38458da04fef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Aug 25 03:27:13.496388 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 584/1202] 10.222.0.75 () {64 vars in 1317 bytes} [Thu Aug 25 03:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 25 03:27:14.083328 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:14.083916 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:14.090519 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:14.091113 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:14.091637 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:14.092262 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:14.092712 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:14.093138 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:14.128951 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:14.129455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:14.129897 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:14.130356 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.objects.instance [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lazy-loading 'fault' on Instance uuid cb65a89a-eefb-47cd-9338-1adebe2707f0 {{(pid=121256) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 25 03:27:14.173187 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.policy [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b841ba312a6e4b919719c3166248c149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bb0777527214f059e031c3b484a2eb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121256) authorize /opt/stack/nova/nova/policy.py:199}} Aug 25 03:27:14.182383 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-3a06afc8-a224-459c-8fb3-83b08a3c2a41 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 200 len: 1230 microversion: 2.1 time: 0.103207 Aug 25 03:27:14.189971 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 619/1203] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:14 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 25 03:27:15.206577 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:15.207207 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: cb65a89a-eefb-47cd-9338-1adebe2707f0] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:15.214137 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.214620 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.215056 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.215762 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.216266 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.216666 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.232798 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] HTTP exception thrown: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Request method failure captured: Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 HTTP/1.1 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBup3fIwEETysrsFr984NSI_XlCu88njTW1QHCVhe3ICEmIvVAiKpnAuUsmBFvJcJnR8yFexVqhr6IP_oRBLrzV4YNV-tLAcd8srBWMfiEFLSXg7RhVgzZhzd_xnM06nZ5DsqQn6mpPYQjUPnqfJzgCY-qOZVY1Q0koaNvBRkzS-i1LY Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:27:15.234498 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0bb0777527214f059e031c3b484a2eb1"}]}] Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b841ba312a6e4b919719c3166248c149 Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. Aug 25 03:27:15.237188 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': 'cb65a89a-eefb-47cd-9338-1adebe2707f0'} Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:15.238191 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. Aug 25 03:27:15.239931 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.241839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Returning 404 to user: Instance cb65a89a-eefb-47cd-9338-1adebe2707f0 could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:15.241839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-430335d3-0b46-4c99-bf59-af1889793b92 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0" status: 404 len: 111 microversion: 2.1 time: 0.034506 Aug 25 03:27:15.241839 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 585/1204] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:15 2022] GET /compute/v2.1/servers/cb65a89a-eefb-47cd-9338-1adebe2707f0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:15.819455 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:15.820045 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.compute.api [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121256) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:15.826490 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.826970 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.827500 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.828234 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.828683 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.829101 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG oslo_concurrency.lockutils [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121256) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.843056 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.wsgi [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] HTTP exception thrown: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Request method failure captured: Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: request: DELETE /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f HTTP/1.1 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept: application/json Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Accept-Encoding: identity Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Connection: close Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Length: 0 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Content-Type: application/json Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Host: 10.222.0.75 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: Openstack-System-Scope: None Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Auth-Token: gAAAAABjBup3fIwEETysrsFr984NSI_XlCu88njTW1QHCVhe3ICEmIvVAiKpnAuUsmBFvJcJnR8yFexVqhr6IP_oRBLrzV4YNV-tLAcd8srBWMfiEFLSXg7RhVgzZhzd_xnM06nZ5DsqQn6mpPYQjUPnqfJzgCY-qOZVY1Q0koaNvBRkzS-i1LY Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Id: None Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Domain-Name: None Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Identity-Status: Confirmed Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Is-Admin-Project: True Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Id: default Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Domain-Name: Default Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Project-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Role: member,reader Aug 25 03:27:15.844944 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Roles: member,reader Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0bb0777527214f059e031c3b484a2eb1"}]}] Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-Tenant-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Id: default Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Domain-Name: Default Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Id: b841ba312a6e4b919719c3166248c149 Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: X-User-Name: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: method: > Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: exception: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.846625 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: action_args: {'id': '5a9a2602-9471-4825-93c1-7adbec0cc61f'} Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:15.847611 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.849494 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.851480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Returning 404 to user: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. {{(pid=121256) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:15.851480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-daeb67eb-b751-4d10-b42c-face0c85e0c4 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "DELETE /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 25 03:27:15.851480 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 620/1205] 10.222.0.75 () {58 vars in 1239 bytes} [Thu Aug 25 03:27:15 2022] DELETE /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:15.860638 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '>' {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:15.862475 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.compute.api [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] [instance: 5a9a2602-9471-4825-93c1-7adbec0cc61f] Fetching instance by UUID {{(pid=121255) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 25 03:27:15.868689 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.869174 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.869614 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.870346 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Acquiring lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 25 03:27:15.870795 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 25 03:27:15.871216 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG oslo_concurrency.lockutils [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Lock "429328db-c6b7-4f53-8dd7-047f5c486dbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121255) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 25 03:27:15.888924 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.wsgi [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] HTTP exception thrown: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Request method failure captured: Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: request: GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f HTTP/1.1 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept: application/json Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Accept-Encoding: identity Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Connection: close Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Length: 0 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Content-Type: application/json Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Host: 10.222.0.75 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: Openstack-System-Scope: None Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: User-Agent: python-urllib3/1.26.11 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Auth-Token: gAAAAABjBup3fIwEETysrsFr984NSI_XlCu88njTW1QHCVhe3ICEmIvVAiKpnAuUsmBFvJcJnR8yFexVqhr6IP_oRBLrzV4YNV-tLAcd8srBWMfiEFLSXg7RhVgzZhzd_xnM06nZ5DsqQn6mpPYQjUPnqfJzgCY-qOZVY1Q0koaNvBRkzS-i1LY Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Id: None Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Domain-Name: None Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Identity-Status: Confirmed Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Is-Admin-Project: True Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Id: default Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Domain-Name: Default Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Project-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Role: member,reader Aug 25 03:27:15.890496 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Roles: member,reader Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/0bb0777527214f059e031c3b484a2eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_0bb0777527214f059e031c3b484a2eb1"}]}] Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Id: 0bb0777527214f059e031c3b484a2eb1 Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-Tenant-Name: tempest-TestVolumeBootPattern-222743624 Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Id: default Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Domain-Name: Default Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Id: b841ba312a6e4b919719c3166248c149 Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: X-User-Name: tempest-TestVolumeBootPattern-222743624-project Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: method: > Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: exception: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.892228 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: action_args: {'id': '5a9a2602-9471-4825-93c1-7adbec0cc61f'} Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: {{(pid=121255) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 25 03:27:15.893271 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. Aug 25 03:27:15.895372 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: ERROR nova.api.openstack.wsgi Aug 25 03:27:15.897527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: DEBUG nova.api.openstack.wsgi [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Returning 404 to user: Instance 5a9a2602-9471-4825-93c1-7adbec0cc61f could not be found. {{(pid=121255) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 25 03:27:15.897527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: INFO nova.api.openstack.requestlog [None req-2093b512-c169-4611-b29f-67b3dd582c15 tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f" status: 404 len: 111 microversion: 2.1 time: 0.035218 Aug 25 03:27:15.897527 dv-cinder-779578-6-iscsi devstack@n-api.service[121255]: [pid: 121255|app: 0|req: 586/1206] 10.222.0.75 () {58 vars in 1236 bytes} [Thu Aug 25 03:27:15 2022] GET /compute/v2.1/servers/5a9a2602-9471-4825-93c1-7adbec0cc61f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 25 03:27:17.727074 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: DEBUG nova.api.openstack.wsgi [None req-9bebef0e-3f26-4476-a59a-507a19b969eb tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] Calling method '.version_select at 0x7ff197b77ca0>' {{(pid=121256) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 25 03:27:17.911910 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: INFO nova.api.openstack.requestlog [None req-9bebef0e-3f26-4476-a59a-507a19b969eb tempest-TestVolumeBootPattern-222743624 tempest-TestVolumeBootPattern-222743624-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-814321191" status: 202 len: 0 microversion: 2.1 time: 0.188776 Aug 25 03:27:17.912533 dv-cinder-779578-6-iscsi devstack@n-api.service[121256]: [pid: 121256|app: 0|req: 621/1207] 10.222.0.75 () {58 vars in 1260 bytes} [Thu Aug 25 03:27:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-814321191 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)